-
Notifications
You must be signed in to change notification settings - Fork 17
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Product Custom Option Import is not working. #268
Comments
Hi @Mardl, |
I was able to resolve the issue of "additional categories" after removing categories from other store views. Kept the categories for admin store view only and it stopped creating additional categories after import. |
Preconditions
Project Environment
Magento Cloud Version: 2.4.2-p1
PHP: 7.4
Database: MariaDB 10.4.14
Techdivision Import Cli : 3.8.53
Steps to reproduce
Sample Import File Data
Actual Result
Prduct is imported with all the attributes.
Custom Options for products are not created.
Products are assigned to their respective categories but some phantom categories are created after the import.
Also getting the following exception if trying to update existing products using import. This issue is intermittent.
{"message":" _______ _ _____ _ _ _\n|__ __| | | | __ \\(_) (_) (_)\n | | ___ ___| |__ | | | |___ ___ ___ _ ___ _ __\n | |/ _ \\/ __| \\_ \\| | | | \\ \\ / / / __| |/ _ \\| \\_ \\\n | | __/ (__| | | | |__| | |\\ V /| \\__ \\ | (_) | | | |\n |_|\\___|\\___|_| |_|_____/|_| \\_/ |_|___/_|\\___/|_| |_|\n Now start import with serial 4d71c4b3-8674-4e47-96f3-21b9599f6ea4 [catalog_product => add-update]\n+--------------------------------+-------+----------------------------------------------------------------------------------+\n| Variable | Value | Description |\n+--------------------------------+-------+----------------------------------------------------------------------------------+\n| innodb_flush_log_at_trx_commit | 1 | Your setting for may result in a significantly slower performance. Consider to s |\n| | | witch this value to 0 or 2 to improve performance. Read more about that topic on |\n| | | the MySQL website https://dev.mysql.com/doc/refman/5.7/en/innodb-parameters.html |\n| | | #sysvar_innodb_flush_log_at_trx_commit. |\n+--------------------------------+-------+----------------------------------------------------------------------------------+\n[2022-04-04 15:00:13] logger/system.NOTICE: Successfully processed file \"product-import_20220404-080011_01.csv\" with \"1182\" lines (skipped \"0\") in \"0.129460\" s {\"operation-name\":\"general/catalog_product/collect-data\"} {\"serial\":\"4d71c4b3-8674-4e47-96f3-21b9599f6ea4\",\"memory_peak_usage\":\"32 MB\"}\n[2022-04-04 15:00:13] logger/system.NOTICE: Observer \"TechDivision\\Import\\Observers\\GenericHookAwareColumnCollectorObserver\" successfully updated status data for \"collected_columns\" {\"serial\":\"4d71c4b3-8674-4e47-96f3-21b9599f6ea4\",\"memory_peak_usage\":\"32 MB\"}\n[2022-04-04 15:00:17] logger/system.NOTICE: Successfully processed file \"product-import_20220404-080011_01.csv\" with \"1182\" lines (skipped \"0\") in \"4.729939\" s {\"operation-name\":\"general/eav_attribute/convert\"} {\"serial\":\"4d71c4b3-8674-4e47-96f3-21b9599f6ea4\",\"memory_peak_usage\":\"34 MB\"}\n[2022-04-04 15:00:18] logger/system.NOTICE: Successfully processed file \"product-import_20220404-080011_01.csv\" with \"1182\" lines (skipped \"0\") in \"0.169692\" s {\"operation-name\":\"general/catalog_category/convert\"} {\"serial\":\"4d71c4b3-8674-4e47-96f3-21b9599f6ea4\",\"memory_peak_usage\":\"34 MB\"}\n[2022-04-04 15:00:18] logger/system.NOTICE: Successfully processed file \"category-import_20220404-150018_01.csv\" with \"4\" lines (skipped \"0\") in \"0.000354\" s {\"operation-name\":\"ce/catalog_category/sort\"} {\"serial\":\"4d71c4b3-8674-4e47-96f3-21b9599f6ea4\",\"memory_peak_usage\":\"34 MB\"}\n[2022-04-04 15:00:18] logger/system.NOTICE: Successfully processed file \"category-create_20220404-150018_01.csv\" with \"4\" lines (skipped \"0\") in \"0.079053\" s {\"operation-name\":\"ee/catalog_category/add-update\"} {\"serial\":\"4d71c4b3-8674-4e47-96f3-21b9599f6ea4\",\"memory_peak_usage\":\"34 MB\"}\n[2022-04-04 15:00:18] logger/system.NOTICE: Successfully processed file \"category-path_20220404-150018_01.csv\" with \"12\" lines (skipped \"0\") in \"0.014969\" s {\"operation-name\":\"ee/catalog_category/add-update.path\"} {\"serial\":\"4d71c4b3-8674-4e47-96f3-21b9599f6ea4\",\"memory_peak_usage\":\"34 MB\"}\nPHP Notice: Trying to access array offset on value of type bool in /var/www/migration/vendor/techdivision/import/src/Subjects/AbstractSubject.php on line 1412\nPHP Notice: Trying to access array offset on value of type bool in /var/www/migration/vendor/techdivision/import/src/Subjects/AbstractSubject.php on line 1413\n[2022-04-04 15:00:18] logger/system.ERROR: PDOException: SQLSTATE[23000]: Integrity constraint violation: 1062 Duplicate entry 'coloured-diamond-jewellery-3' for key 'URL_REWRITE_REQUEST_PATH_STORE_ID' in /var/www/migration/vendor/techdivision/import/src/Actions/Processors/AbstractBaseProcessor.php:222\nStack trace:\n#0 /var/www/migration/vendor/techdivision/import/src/Actions/Processors/AbstractBaseProcessor.php(222): PDOStatement->execute()\n#1 /var/www/migration/vendor/techdivision/import/src/Actions/Processors/UrlRewriteCreateProcessor.php(61): TechDivision\\Import\\Actions\\Processors\\AbstractBaseProcessor->execute()\n#2 /var/www/migration/vendor/techdivision/import/src/Actions/GenericIdentifierAction.php(73): TechDivision\\Import\\Actions\\Processors\\UrlRewriteCreateProcessor->execute()\n#3 /var/www/migration/vendor/techdivision/import/src/Actions/GenericIdentifierAction.php(60): TechDivision\\Import\\Actions\\GenericIdentifierAction->create()\n#4 /var/www/migration/vendor/techdivision/import-category/src/Services/CategoryBunchProcessor.php(1166): TechDivision\\Import\\Actions\\GenericIdentifierAction->persist()\n#5 /var/www/migration/vendor/techdivision/import-category/src/Observers/UrlRewriteObserver.php(238): TechDivision\\Import\\Category\\Services\\CategoryBunchProcessor->persistUrlRewrite()\n#6 /var/www/migration/vendor/techdivision/import-category/src/Observers/UrlRewriteObserver.php(108): TechDivision\\Import\\Category\\Observers\\UrlRewriteObserver->persistUrlRewrite()\n#7 /var/www/migration/vendor/techdivision/import-category/src/Observers/UrlRewriteUpdateObserver.php(89): TechDivision\\Import\\Category\\Observers\\UrlRewriteObserver->process()\n#8 /var/www/migration/vendor/techdivision/import-category/src/Observers/AbstractCategoryImportObserver.php(54): TechDivision\\Import\\Category\\Observers\\UrlRewriteUpdateObserver->process()\n#9 /var/www/migration/vendor/techdivision/import/src/Subjects/AbstractSubject.php(1042): TechDivision\\Import\\Category\\Observers\\AbstractCategoryImportObserver->handle()\n#10 [internal function]: TechDivision\\Import\\Subjects\\AbstractSubject->importRow()\n#11 /var/www/migration/vendor/techdivision/import/src/Adapter/Goodby/Interpreter.php(149): call_user_func()\n#12 /var/www/migration/vendor/techdivision/import/src/Adapter/Goodby/Interpreter.php(135): TechDivision\\Import\\Adapter\\Goodby\\Interpreter->delegate()\n#13 /var/www/migration/vendor/techdivision/import/src/Adapter/Goodby/Interpreter.php(74): TechDivision\\Import\\Adapter\\Goodby\\Interpreter->notify()\n#14 /var/www/migration/vendor/techdivision/import/src/Adapter/Goodby/Lexer.php(127): TechDivision\\Import\\Adapter\\Goodby\\Interpreter->interpret()\n#15 /var/www/migration/vendor/techdivision/import/src/Adapter/CsvImportAdapter.php(142): TechDivision\\Import\\Adapter\\Goodby\\Lexer->parse()\n#16 /var/www/migration/vendor/techdivision/import/src/Subjects/AbstractSubject.php(884): TechDivision\\Import\\Adapter\\CsvImportAdapter->import()\n#17 /var/www/migration/vendor/techdivision/import/src/Subjects/SubjectExecutor.php(131): TechDivision\\Import\\Subjects\\AbstractSubject->import()\n#18 /var/www/migration/vendor/techdivision/import/src/Plugins/SubjectPlugin.php(168): TechDivision\\Import\\Subjects\\SubjectExecutor->execute()\n#19 /var/www/migration/vendor/techdivision/import/src/Plugins/SubjectPlugin.php(120): TechDivision\\Import\\Plugins\\SubjectPlugin->processSubject()\n#20 /var/www/migration/vendor/techdivision/import/src/Plugins/PluginExecutor.php(117): TechDivision\\Import\\Plugins\\SubjectPlugin->process()\n#21 /var/www/migration/vendor/techdivision/import/src/Modules/PluginModule.php(144): TechDivision\\Import\\Plugins\\PluginExecutor->execute()\n#22 /var/www/migration/vendor/techdivision/import-app-simple/src/Simple.php(622): TechDivision\\Import\\Modules\\PluginModule->process()\n#23 /var/www/migration/vendor/techdivision/import-cli/src/Command/AbstractImportCommand.php(114): TechDivision\\Import\\App\\Simple->process()\n#24 /var/www/migration/vendor/symfony/console/Command/Command.php(255): TechDivision\\Import\\Cli\\Command\\AbstractImportCommand->execute()\n#25 /var/www/migration/vendor/symfony/console/Application.php(1009): Symfony\\Component\\Console\\Command\\Command->run()\n#26 /var/www/migration/vendor/symfony/console/Application.php(273): Symfony\\Component\\Console\\Application->doRunCommand()\n#27 /var/www/migration/vendor/symfony/console/Application.php(149): Symfony\\Component\\Console\\Application->doRun()\n#28 /var/www/migration/vendor/techdivision/import-cli-simple/bootstrap.php(53): Symfony\\Component\\Console\\Application->run()\n#29 /var/www/migration/vendor/techdivision/import-cli-simple/bin/import-simple.php(54): require('/var/www/migrat...')\n#30 /var/www/migration/vendor/techdivision/import-cli-simple/bin/import-simple(2): require('/var/www/migrat...')\n#31 {main}\n\nNext PDOException: SQLSTATE[23000]: Integrity constraint violation: 1062 Duplicate entry 'coloured-diamond-jewellery-3' for key 'URL_REWRITE_REQUEST_PATH_STORE_ID' when executing SQL \"INSERT\n INTO url_rewrite\n (entity_type,\n entity_id,\n request_path,\n target_path,\n redirect_type,\n store_id,\n description,\n is_autogenerated,\n metadata)\n VALUES (category,\n 230,\n coloured-diamond-jewellery,\n catalog/category/view/id/230,\n 0,\n 3,\n ,\n 1,\n )\" in /var/www/migration/vendor/techdivision/import/src/Actions/Processors/AbstractBaseProcessor.php:236\nStack trace:\n#0 /var/www/migration/vendor/techdivision/import/src/Actions/Processors/UrlRewriteCreateProcessor.php(61): TechDivision\\Import\\Actions\\Processors\\AbstractBaseProcessor->execute()\n#1 /var/www/migration/vendor/techdivision/import/src/Actions/GenericIdentifierAction.php(73): TechDivision\\Import\\Actions\\Processors\\UrlRewriteCreateProcessor->execute()\n#2 /var/www/migration/vendor/techdivision/import/src/Actions/GenericIdentifierAction.php(60): TechDivision\\Import\\Actions\\GenericIdentifierAction->create()\n#3 /var/www/migration/vendor/techdivision/import-category/src/Services/CategoryBunchProcessor.php(1166): TechDivision\\Import\\Actions\\GenericIdentifierAction->persist()\n#4 /var/www/migration/vendor/techdivision/import-category/src/Observers/UrlRewriteObserver.php(238): TechDivision\\Import\\Category\\Services\\CategoryBunchProcessor->persistUrlRewrite()\n#5 /var/www/migration/vendor/techdivision/import-category/src/Observers/UrlRewriteObserver.php(108): TechDivision\\Import\\Category\\Observers\\UrlRewriteObserver->persistUrlRewrite()\n#6 /var/www/migration/vendor/techdivision/import-category/src/Observers/UrlRewriteUpdateObserver.php(89): TechDivision\\Import\\Category\\Observers\\UrlRewriteObserver->process()\n#7 /var/www/migration/vendor/techdivision/import-category/src/Observers/AbstractCategoryImportObserver.php(54): TechDivision\\Import\\Category\\Observers\\UrlRewriteUpdateObserver->process()\n#8 /var/www/migration/vendor/techdivision/import/src/Subjects/AbstractSubject.php(1042): TechDivision\\Import\\Category\\Observers\\AbstractCategoryImportObserver->handle()\n#9 [internal function]: TechDivision\\Import\\Subjects\\AbstractSubject->importRow()\n#10 /var/www/migration/vendor/techdivision/import/src/Adapter/Goodby/Interpreter.php(149): call_user_func()\n#11 /var/www/migration/vendor/techdivision/import/src/Adapter/Goodby/Interpreter.php(135): TechDivision\\Import\\Adapter\\Goodby\\Interpreter->delegate()\n#12 /var/www/migration/vendor/techdivision/import/src/Adapter/Goodby/Interpreter.php(74): TechDivision\\Import\\Adapter\\Goodby\\Interpreter->notify()\n#13 /var/www/migration/vendor/techdivision/import/src/Adapter/Goodby/Lexer.php(127): TechDivision\\Import\\Adapter\\Goodby\\Interpreter->interpret()\n#14 /var/www/migration/vendor/techdivision/import/src/Adapter/CsvImportAdapter.php(142): TechDivision\\Import\\Adapter\\Goodby\\Lexer->parse()\n#15 /var/www/migration/vendor/techdivision/import/src/Subjects/AbstractSubject.php(884): TechDivision\\Import\\Adapter\\CsvImportAdapter->import()\n#16 /var/www/migration/vendor/techdivision/import/src/Subjects/SubjectExecutor.php(131): TechDivision\\Import\\Subjects\\AbstractSubject->import()\n#17 /var/www/migration/vendor/techdivision/import/src/Plugins/SubjectPlugin.php(168): TechDivision\\Import\\Subjects\\SubjectExecutor->execute()\n#18 /var/www/migration/vendor/techdivision/import/src/Plugins/SubjectPlugin.php(120): TechDivision\\Import\\Plugins\\SubjectPlugin->processSubject()\n#19 /var/www/migration/vendor/techdivision/import/src/Plugins/PluginExecutor.php(117): TechDivision\\Import\\Plugins\\SubjectPlugin->process()\n#20 /var/www/migration/vendor/techdivision/import/src/Modules/PluginModule.php(144): TechDivision\\Import\\Plugins\\PluginExecutor->execute()\n#21 /var/www/migration/vendor/techdivision/import-app-simple/src/Simple.php(622): TechDivision\\Import\\Modules\\PluginModule->process()\n#22 /var/www/migration/vendor/techdivision/import-cli/src/Command/AbstractImportCommand.php(114): TechDivision\\Import\\App\\Simple->process()\n#23 /var/www/migration/vendor/symfony/console/Command/Command.php(255): TechDivision\\Import\\Cli\\Command\\AbstractImportCommand->execute()\n#24 /var/www/migration/vendor/symfony/console/Application.php(1009): Symfony\\Component\\Console\\Command\\Command->run()\n#25 /var/www/migration/vendor/symfony/console/Application.php(273): Symfony\\Component\\Console\\Application->doRunCommand()\n#26 /var/www/migration/vendor/symfony/console/Application.php(149): Symfony\\Component\\Console\\Application->doRun()\n#27 /var/www/migration/vendor/techdivision/import-cli-simple/bootstrap.php(53): Symfony\\Component\\Console\\Application->run()\n#28 /var/www/migration/vendor/techdivision/import-cli-simple/bin/import-simple.php(54): require('/var/www/migrat...')\n#29 /var/www/migration/vendor/techdivision/import-cli-simple/bin/import-simple(2): require('/var/www/migrat...')\n#30 {main}\n\nNext TechDivision\\Import\\Exceptions\\WrappedColumnException: SQLSTATE[23000]: Integrity constraint violation: 1062 Duplicate entry 'coloured-diamond-jewellery-3' for key 'URL_REWRITE_REQUEST_PATH_STORE_ID' when executing SQL \"INSERT\n INTO url_rewrite\n (entity_type,\n entity_id,\n request_path,\n target_path,\n redirect_type,\n store_id,\n description,\n is_autogenerated,\n metadata)\n VALUES (category,\n 230,\n coloured-diamond-jewellery,\n catalog/category/view/id/230,\n 0,\n 3,\n ,\n 1,\n )\" in file category-url-rewrite_20220404-150018_01.csv on line 2 in /var/www/migration/vendor/techdivision/import/src/Subjects/AbstractSubject.php:1437\nStack trace:\n#0 /var/www/migration/vendor/techdivision/import/src/Subjects/AbstractSubject.php(960): TechDivision\\Import\\Subjects\\AbstractSubject->wrapException()\n#1 /var/www/migration/vendor/techdivision/import/src/Subjects/SubjectExecutor.php(131): TechDivision\\Import\\Subjects\\AbstractSubject->import()\n#2 /var/www/migration/vendor/techdivision/import/src/Plugins/SubjectPlugin.php(168): TechDivision\\Import\\Subjects\\SubjectExecutor->execute()\n#3 /var/www/migration/vendor/techdivision/import/src/Plugins/SubjectPlugin.php(120): TechDivision\\Import\\Plugins\\SubjectPlugin->processSubject()\n#4 /var/www/migration/vendor/techdivision/import/src/Plugins/PluginExecutor.php(117): TechDivision\\Import\\Plugins\\SubjectPlugin->process()\n#5 /var/www/migration/vendor/techdivision/import/src/Modules/PluginModule.php(144): TechDivision\\Import\\Plugins\\PluginExecutor->execute()\n#6 /var/www/migration/vendor/techdivision/import-app-simple/src/Simple.php(622): TechDivision\\Import\\Modules\\PluginModule->process()\n#7 /var/www/migration/vendor/techdivision/import-cli/src/Command/AbstractImportCommand.php(114): TechDivision\\Import\\App\\Simple->process()\n#8 /var/www/migration/vendor/symfony/console/Command/Command.php(255): TechDivision\\Import\\Cli\\Command\\AbstractImportCommand->execute()\n#9 /var/www/migration/vendor/symfony/console/Application.php(1009): Symfony\\Component\\Console\\Command\\Command->run()\n#10 /var/www/migration/vendor/symfony/console/Application.php(273): Symfony\\Component\\Console\\Application->doRunCommand()\n#11 /var/www/migration/vendor/symfony/console/Application.php(149): Symfony\\Component\\Console\\Application->doRun()\n#12 /var/www/migration/vendor/techdivision/import-cli-simple/bootstrap.php(53): Symfony\\Component\\Console\\Application->run()\n#13 /var/www/migration/vendor/techdivision/import-cli-simple/bin/import-simple.php(54): require('/var/www/migrat...')\n#14 /var/www/migration/vendor/techdivision/import-cli-simple/bin/import-simple(2): require('/var/www/migrat...')\n#15 {main} {\"serial\":\"4d71c4b3-8674-4e47-96f3-21b9599f6ea4\",\"memory_peak_usage\":\"36 MB\"}\n[2022-04-04 15:00:18] logger/system.ERROR: Can't finish import with serial 4d71c4b3-8674-4e47-96f3-21b9599f6ea4 in 5.360415 s {\"serial\":\"4d71c4b3-8674-4e47-96f3-21b9599f6ea4\",\"memory_peak_usage\":\"36 MB\"}\n SQLSTATE[23000]: Integrity constraint violation: 1062 Duplicate entry 'coloured-diamond-jewellery-3' for key 'URL_REWRITE_REQUEST_PATH_STORE_ID' when executing SQL \"INSERT\n INTO url_rewrite\n (entity_type,\n entity_id,\n request_path,\n target_path,\n redirect_type,\n store_id,\n description,\n is_autogenerated,\n metadata)\n VALUES (category,\n 230,\n coloured-diamond-jewellery,\n catalog/category/view/id/230,\n 0,\n 3,\n ,\n 1,\n )\" in file category-url-rewrite_20220404-150018_01.csv on line 2\n[2022-04-04 15:00:18] logger/system.ERROR: SQLSTATE[23000]: Integrity constraint violation: 1062 Duplicate entry 'coloured-diamond-jewellery-3' for key 'URL_REWRITE_REQUEST_PATH_STORE_ID' when executing SQL \"INSERT\n INTO url_rewrite\n (entity_type,\n entity_id,\n request_path,\n target_path,\n redirect_type,\n store_id,\n description,\n is_autogenerated,\n metadata)\n VALUES (category,\n 230,\n coloured-diamond-jewellery,\n catalog/category/view/id/230,\n 0,\n 3,\n ,\n 1,\n )\" in file category-url-rewrite_20220404-150018_01.csv on line 2 {\"serial\":\"4d71c4b3-8674-4e47-96f3-21b9599f6ea4\",\"memory_peak_usage\":\"36 MB\"}","context":[],"level":200,"level_name":"INFO","channel":"import_feed","datetime":{"date":"2022-04-04 15:00:18.212492","timezone_type":3,"timezone":"UTC"},"extra":{"file":"/var/www/migration/app/code/BestResponseMedia/ImportProducts/Model/FilePreparation/Entities/ProductImportFileGenerator.php","line":208,"class":"BestResponseMedia\\ImportProducts\\Model\\FilePreparation\\Entities\\ProductImportFileGenerator","function":"initiateProductImport"}}
Expected Result
The text was updated successfully, but these errors were encountered: