Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

DeepLCFeatureGenerator multiprocessing issue when number of processes is more than 1 #151

Open
vrkosk opened this issue May 23, 2024 · 2 comments

Comments

@vrkosk
Copy link

vrkosk commented May 23, 2024

When I run DeepLCFeatureGenerator with processes=8, it takes a long time, much longer than processes=1. Python correctly starts 8 python.exe multiprocesses, but often the execution just hangs (I've waited more than 30 minutes -- using processes=1, it took less than 5 minutes). It's actually faster to run DeepLCFeatureGenerator with just processes=1 and it seems to work every time.

I can provide a test case if this isn't a known issue already.

@RobbinBouwmeester
Copy link
Member

Hi, there have been some significant updates lately. Can you confirm for the latest versions this is still an issue.

@vrkosk
Copy link
Author

vrkosk commented Aug 5, 2024

It will be a while before I can test the latest version, sorry.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants