Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Review Thread creation and re-usage through the application #1853

Open
lfcnassif opened this issue Aug 31, 2023 · 0 comments
Open

Review Thread creation and re-usage through the application #1853

lfcnassif opened this issue Aug 31, 2023 · 0 comments

Comments

@lfcnassif
Copy link
Member

lfcnassif commented Aug 31, 2023

Tests done on #1834 and preliminary results on #1850 suggest me thread concurrency can be very bad... For a long time I have seen in task manager a lot of CPU time spent as "kernel time", that may mean lots of context switches (not sure) or maybe just kernel function calls like IO calls (which shouldn't use much CPU...). I'm also kind surprised by how much IPED uses the CPU on machines with 48 logical cores with CPU bound tasks like OCR disabled, since processing evidences usually is IO bound...

We have short lived Threads creation in some places, and also Threads used just to consume external processes output/error streams. Those may cause more context switches than necessary.

A single (or a few) common Thread Pool to be reused by application modules may optimize processing because of less context switches, I think this is worth to test...

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant