Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

«Memory size allocated for the temporary table is more than 20% of innodb_buffer_pool_size» for Magento\Catalog\Model\Indexer\Product\Eav\Action\Full #25

Open
dmitrii-fediuk opened this issue Feb 12, 2024 · 0 comments

Comments

@dmitrii-fediuk
Copy link
Contributor

dmitrii-fediuk commented Feb 12, 2024

Similar to canadasatellite-ca/site#47, canadasatellite-ca/site#69

[
	Mage2.PRO: {
	    "mage2pro/core": "10.6.0",
	    "Magento": "2.4.6",
	    "PHP": "8.1.21",
	    "Command": "bin/magento cron:run --group=index --bootstrap=standaloneProcessStarted=1"
	}
	channel: main
	context: []
	datetime: Monolog\DateTimeImmutable "2024-02-11T23:00:15.798506+00:00"
	extra: []
	level: 300
	level_name: WARNING
	message: Memory size allocated for the temporary table is more than 20% of innodb_buffer_pool_size. Please update innodb_buffer_pool_size or decrease batch size value (which decreases memory usages for the temporary table). Current batch size: 100000; Allocated memory size: 2280000000 bytes; InnoDB buffer pool size: 8589934592 bytes.
]

1	Df\Framework\Log\Dispatcher::handle
	https://github.com/mage2pro/core/tree/10.6.0/Framework/Log/Dispatcher.php#L97
	vendor/mage2pro/core/Framework/Log/Dispatcher.php:97

2	Monolog\Logger::addRecord
	vendor/monolog/monolog/src/Monolog/Logger.php:399

3	Monolog\Logger::warning
	vendor/monolog/monolog/src/Monolog/Logger.php:637

4	Magento\Framework\Logger\LoggerProxy::warning
	https://github.com/magento/magento2/tree/2.4.6/lib/internal/Magento/Framework/Logger/LoggerProxy.php#L139
	vendor/magento/framework/Logger/LoggerProxy.php:139

5	Magento\Framework\Indexer\BatchSizeManagement::ensureBatchSize
	https://github.com/magento/magento2/tree/2.4.6/lib/internal/Magento/Framework/Indexer/BatchSizeManagement.php#L57
	vendor/magento/framework/Indexer/BatchSizeManagement.php:57

6	Magento\Catalog\Model\Indexer\Category\Product\Action\Full::reindexCategoriesBySelect
	https://github.com/magento/magento2/tree/2.4.6/app/code/Magento/Catalog/Model/Indexer/Category/Product/Action/Full.php#L291
	vendor/magento/module-catalog/Model/Indexer/Category/Product/Action/Full.php:291

7	Magento\Catalog\Model\Indexer\Category\Product\Action\Full::reindexNonAnchorCategories
	https://github.com/magento/magento2/tree/2.4.6/app/code/Magento/Catalog/Model/Indexer/Category/Product/Action/Full.php#L267
	vendor/magento/module-catalog/Model/Indexer/Category/Product/Action/Full.php:267

8	Magento\Catalog\Model\Indexer\Category\Product\Action\Full::reindexStore
	https://github.com/magento/magento2/tree/2.4.6/app/code/Magento/Catalog/Model/Indexer/Category/Product/Action/Full.php#L211
	vendor/magento/module-catalog/Model/Indexer/Category/Product/Action/Full.php:211

9	Magento\Catalog\Model\Indexer\Category\Product\Action\Full::Magento\Catalog\Model\Indexer\Category\Product\Action\{closure}
	https://github.com/magento/magento2/tree/2.4.6/app/code/Magento/Catalog/Model/Indexer/Category/Product/Action/Full.php#L194
	vendor/magento/module-catalog/Model/Indexer/Category/Product/Action/Full.php:194

10	call_user_func
	0

11	Magento\Indexer\Model\ProcessManager::simpleThreadExecute
	https://github.com/magento/magento2/tree/2.4.6/app/code/Magento/Indexer/Model/ProcessManager.php#L88
	vendor/magento/module-indexer/Model/ProcessManager.php:88

12	Magento\Indexer\Model\ProcessManager::execute
	https://github.com/magento/magento2/tree/2.4.6/app/code/Magento/Indexer/Model/ProcessManager.php#L75
	vendor/magento/module-indexer/Model/ProcessManager.php:75

13	Magento\Catalog\Model\Indexer\Category\Product\Action\Full::reindex
	https://github.com/magento/magento2/tree/2.4.6/app/code/Magento/Catalog/Model/Indexer/Category/Product/Action/Full.php#L199
	vendor/magento/module-catalog/Model/Indexer/Category/Product/Action/Full.php:199

14	Magento\Catalog\Model\Indexer\Category\Product\Action\Full::execute
	https://github.com/magento/magento2/tree/2.4.6/app/code/Magento/Catalog/Model/Indexer/Category/Product/Action/Full.php#L176
	vendor/magento/module-catalog/Model/Indexer/Category/Product/Action/Full.php:176

15	Magento\Catalog\Model\Indexer\Category\Product\Action\Full::___callParent
	https://github.com/magento/magento2/tree/2.4.6/lib/internal/Magento/Framework/Interception/Interceptor.php#L58
	vendor/magento/framework/Interception/Interceptor.php:58

16	Magento\Catalog\Model\Indexer\Category\Product\Action\Full::Magento\Framework\Interception\{closure}
	https://github.com/magento/magento2/tree/2.4.6/lib/internal/Magento/Framework/Interception/Interceptor.php#L138
	vendor/magento/framework/Interception/Interceptor.php:138

17	Magento\Catalog\Model\Indexer\Category\Product\Action\Full::___callPlugins
	https://github.com/magento/magento2/tree/2.4.6/lib/internal/Magento/Framework/Interception/Interceptor.php#L153
	vendor/magento/framework/Interception/Interceptor.php:153

18	Magento\Catalog\Model\Indexer\Category\Product\Action\Full::execute
	generated/code/Magento/Catalog/Model/Indexer/Category/Product/Action/Full/Interceptor.php:23

19	Magento\Catalog\Model\Indexer\Category\Product::Magento\Catalog\Model\Indexer\Category\{closure}
	https://github.com/magento/magento2/tree/2.4.6/app/code/Magento/Catalog/Model/Indexer/Category/Product.php#L106
	vendor/magento/module-catalog/Model/Indexer/Category/Product.php:106

20	Magento\Indexer\Model\IndexMutex::execute
	https://github.com/magento/magento2/tree/2.4.6/app/code/Magento/Indexer/Model/IndexMutex.php#L67
	vendor/magento/module-indexer/Model/IndexMutex.php:67

21	Magento\Catalog\Model\Indexer\Category\Product::executeFull
	https://github.com/magento/magento2/tree/2.4.6/app/code/Magento/Catalog/Model/Indexer/Category/Product.php#L108
	vendor/magento/module-catalog/Model/Indexer/Category/Product.php:108

22	Magento\Catalog\Model\Indexer\Category\Product::___callParent
	https://github.com/magento/magento2/tree/2.4.6/lib/internal/Magento/Framework/Interception/Interceptor.php#L58
	vendor/magento/framework/Interception/Interceptor.php:58

23	Magento\Catalog\Model\Indexer\Category\Product::Magento\Framework\Interception\{closure}
	https://github.com/magento/magento2/tree/2.4.6/lib/internal/Magento/Framework/Interception/Interceptor.php#L138
	vendor/magento/framework/Interception/Interceptor.php:138

24	Magento\Catalog\Model\Indexer\Category\Product::___callPlugins
	https://github.com/magento/magento2/tree/2.4.6/lib/internal/Magento/Framework/Interception/Interceptor.php#L153
	vendor/magento/framework/Interception/Interceptor.php:153

25	Magento\Catalog\Model\Indexer\Category\Product::executeFull
	generated/code/Magento/Catalog/Model/Indexer/Category/Product/Interceptor.php:32

26	Magento\Indexer\Model\Indexer::reindexAll
	https://github.com/magento/magento2/tree/2.4.6/app/code/Magento/Indexer/Model/Indexer.php#L443
	vendor/magento/module-indexer/Model/Indexer.php:443

27	Magento\Indexer\Model\Indexer::reindexAll
	generated/code/Magento/Indexer/Model/Indexer/Interceptor.php:230

28	Magento\Indexer\Model\Indexer\DependencyDecorator::reindexAll
	https://github.com/magento/magento2/tree/2.4.6/app/code/Magento/Indexer/Model/Indexer/DependencyDecorator.php#L268
	vendor/magento/module-indexer/Model/Indexer/DependencyDecorator.php:268

29	Magento\Indexer\Model\Processor::reindexAllInvalid
	https://github.com/magento/magento2/tree/2.4.6/app/code/Magento/Indexer/Model/Processor.php#L88
	vendor/magento/module-indexer/Model/Processor.php:88

30	Magento\Indexer\Model\Processor::___callParent
	https://github.com/magento/magento2/tree/2.4.6/lib/internal/Magento/Framework/Interception/Interceptor.php#L58
	vendor/magento/framework/Interception/Interceptor.php:58

31	Magento\Indexer\Model\Processor::Magento\Framework\Interception\{closure}
	https://github.com/magento/magento2/tree/2.4.6/lib/internal/Magento/Framework/Interception/Interceptor.php#L138
	vendor/magento/framework/Interception/Interceptor.php:138

32	Magento\Indexer\Model\Processor::___callPlugins
	https://github.com/magento/magento2/tree/2.4.6/lib/internal/Magento/Framework/Interception/Interceptor.php#L153
	vendor/magento/framework/Interception/Interceptor.php:153

33	Magento\Indexer\Model\Processor::reindexAllInvalid
	generated/code/Magento/Indexer/Model/Processor/Interceptor.php:23

34	Magento\Indexer\Cron\ReindexAllInvalid::execute
	https://github.com/magento/magento2/tree/2.4.6/app/code/Magento/Indexer/Cron/ReindexAllInvalid.php#L31
	vendor/magento/module-indexer/Cron/ReindexAllInvalid.php:31

35	call_user_func_array
	0

36	Magento\Cron\Observer\ProcessCronQueueObserver::_runJob
	https://github.com/magento/magento2/tree/2.4.6/app/code/Magento/Cron/Observer/ProcessCronQueueObserver.php#L368
	vendor/magento/module-cron/Observer/ProcessCronQueueObserver.php:368

37	Magento\Cron\Observer\ProcessCronQueueObserver::tryRunJob
	https://github.com/magento/magento2/tree/2.4.6/app/code/Magento/Cron/Observer/ProcessCronQueueObserver.php#L879
	vendor/magento/module-cron/Observer/ProcessCronQueueObserver.php:879

38	Magento\Cron\Observer\ProcessCronQueueObserver::processPendingJobs
	https://github.com/magento/magento2/tree/2.4.6/app/code/Magento/Cron/Observer/ProcessCronQueueObserver.php#L840
	vendor/magento/module-cron/Observer/ProcessCronQueueObserver.php:840

39	Magento\Cron\Observer\ProcessCronQueueObserver::execute
	https://github.com/magento/magento2/tree/2.4.6/app/code/Magento/Cron/Observer/ProcessCronQueueObserver.php#L280
	vendor/magento/module-cron/Observer/ProcessCronQueueObserver.php:280

40	Magento\Framework\Event\Invoker\InvokerDefault::_callObserverMethod
	https://github.com/magento/magento2/tree/2.4.6/lib/internal/Magento/Framework/Event/Invoker/InvokerDefault.php#L88
	vendor/magento/framework/Event/Invoker/InvokerDefault.php:88

41	Magento\Framework\Event\Invoker\InvokerDefault::dispatch
	https://github.com/magento/magento2/tree/2.4.6/lib/internal/Magento/Framework/Event/Invoker/InvokerDefault.php#L74
	vendor/magento/framework/Event/Invoker/InvokerDefault.php:74

42	Magento\Framework\Event\Manager::dispatch
	https://github.com/magento/magento2/tree/2.4.6/lib/internal/Magento/Framework/Event/Manager.php#L65
	vendor/magento/framework/Event/Manager.php:65

43	Magento\Framework\Event\Manager\Proxy::dispatch
	generated/code/Magento/Framework/Event/Manager/Proxy.php:95

44	Magento\Framework\App\Cron::launch
	https://github.com/magento/magento2/tree/2.4.6/lib/internal/Magento/Framework/App/Cron.php#L86
	vendor/magento/framework/App/Cron.php:86

45	Magento\Framework\App\Cron::launch
	generated/code/Magento/Framework/App/Cron/Interceptor.php:23

46	Magento\Cron\Console\Command\CronCommand::execute
	https://github.com/magento/magento2/tree/2.4.6/app/code/Magento/Cron/Console/Command/CronCommand.php#L126
	vendor/magento/module-cron/Console/Command/CronCommand.php:126

47	Symfony\Component\Console\Command\Command::run
	vendor/symfony/console/Command/Command.php:298

48	Magento\Cron\Console\Command\CronCommand::___callParent
	https://github.com/magento/magento2/tree/2.4.6/lib/internal/Magento/Framework/Interception/Interceptor.php#L58
	vendor/magento/framework/Interception/Interceptor.php:58

49	Magento\Cron\Console\Command\CronCommand::Magento\Framework\Interception\{closure}
	https://github.com/magento/magento2/tree/2.4.6/lib/internal/Magento/Framework/Interception/Interceptor.php#L138
	vendor/magento/framework/Interception/Interceptor.php:138

50	Df\Cron\Plugin\Console\Command\CronCommand::aroundRun
	https://github.com/mage2pro/core/tree/10.6.0/Cron/Plugin/Console/Command/CronCommand.php#L19
	vendor/mage2pro/core/Cron/Plugin/Console/Command/CronCommand.php:19

51	Magento\Cron\Console\Command\CronCommand::Magento\Framework\Interception\{closure}
	https://github.com/magento/magento2/tree/2.4.6/lib/internal/Magento/Framework/Interception/Interceptor.php#L135
	vendor/magento/framework/Interception/Interceptor.php:135

52	Magento\Cron\Console\Command\CronCommand::___callPlugins
	https://github.com/magento/magento2/tree/2.4.6/lib/internal/Magento/Framework/Interception/Interceptor.php#L153
	vendor/magento/framework/Interception/Interceptor.php:153

53	Magento\Cron\Console\Command\CronCommand::run
	generated/code/Magento/Cron/Console/Command/CronCommand/Interceptor.php:77

54	Symfony\Component\Console\Application::doRunCommand
	vendor/symfony/console/Application.php:1040

55	Symfony\Component\Console\Application::doRun
	vendor/symfony/console/Application.php:301

56	Magento\Framework\Console\Cli::doRun
	https://github.com/magento/magento2/tree/2.4.6/lib/internal/Magento/Framework/Console/Cli.php#L116
	vendor/magento/framework/Console/Cli.php:116

57	Symfony\Component\Console\Application::run
	vendor/symfony/console/Application.php:171
@dmitrii-fediuk dmitrii-fediuk changed the title «Memory size allocated for the temporary table is more than 20% of innodb_buffer_pool_size. Please update innodb_buffer_pool_size or decrease batch size value (which decreases memory usages for the temporary table). Current batch size: 100000; Allocated memory size: 2280000000 bytes; InnoDB buffer pool size: 8589934592 bytes.» «Memory size allocated for the temporary table is more than 20% of innodb_buffer_pool_size» for Magento\Catalog\Model\Indexer\Product\Eav\Action\Full Feb 12, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant