Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

RabbitMQ message sizes may get very large and cause problems #38

Open
PasiSa opened this issue Sep 29, 2022 · 0 comments
Open

RabbitMQ message sizes may get very large and cause problems #38

PasiSa opened this issue Sep 29, 2022 · 0 comments

Comments

@PasiSa
Copy link
Contributor

PasiSa commented Sep 29, 2022

When Radar matchlib task has processed the submissions for an exercise, it sends the results back to Radar service in a single RabbitMQ message. If the number of submissions is very large, such as in some exercises of the Y1 course (> 2800 submissions), this causes a large RabbitMQ message between the Celery tasks, that exceeds the default 128 MB maximum message size. In addition, it causes very large memory consumption on RabbitMQ. For now, this problem can be prevented by increasing the max_message_size setting in rabbitmq.conf, but in longer run a better solution in Radar is needed, to distribute the result in smaller messages, and in general to avoid large messages between tasks.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant