Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Make use of Memoizer to cache metadata for subsequent reads #20

Open
imagejan opened this issue Oct 20, 2021 · 4 comments
Open

Make use of Memoizer to cache metadata for subsequent reads #20

imagejan opened this issue Oct 20, 2021 · 4 comments

Comments

@imagejan
Copy link
Member

Any SCIFIO format wrapping around Bio-Formats should ideally make use of loci.formats.Memoizer to speed up subsequent reads of the same file/dataset.

Having a default reader plugin with this functionality for all file formats supported by Bio-Formats would greatly benefit the community. See also this discussion on the image.sc forum.

@hinerm, @ctrueden would you have pointers how to best approach this?

@imagesc-bot
Copy link

This issue has been mentioned on Image.sc Forum. There might be relevant details there:

https://forum.image.sc/t/speeding-up-metamorph-file-reading-with-bioformats/42532/25

@ctrueden
Copy link
Member

ctrueden commented Nov 7, 2021

I agree that it makes sense to tackle this as part of #12. I do not have insight into how to begin, without digging into the code myself, which I will not have time to do before next year, sorry.

@imagejan
Copy link
Member Author

As #12 (splitting into separate readers/writers per file format) seems more involved, an immediate option might be to change this line:

... to something like:

meta.setReader(new Memoizer(reader));

... and see whether it works. 🤷 🙂

Will try when I find the time.

@imagesc-bot
Copy link

This issue has been mentioned on Image.sc Forum. There might be relevant details there:

https://forum.image.sc/t/fiji-should-use-bioformats-memoizer-to-speed-up-opening-of-large-files/66923/2

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants