-
Notifications
You must be signed in to change notification settings - Fork 40
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Would an async api have performance gain? #7
Comments
Thanks! I don't think asynchronous iteration would be helpful in our particular case. Background fetching of the next sample or batch is achieved using the |
If we have a slow IO like remote cloud storage like S3, maybe it would block the prefetch thread pool? |
Fantastic job! But I'd like to ask if there would be some another gains by designing an async implementation and bind them to python with
__anext__
and__aiter__
, since data loading is highly related to IO.The text was updated successfully, but these errors were encountered: