Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Missing data - subfolders #9

Open
simon-donike opened this issue Jan 17, 2023 · 4 comments · May be fixed by microsoft/torchgeo#2558
Open

Missing data - subfolders #9

simon-donike opened this issue Jan 17, 2023 · 4 comments · May be fixed by microsoft/torchgeo#2558
Assignees
@ivanorsolic
Labels
in progress The issue is acknowledged and being solved.

Comments

@simon-donike
Copy link
Contributor

simon-donike commented Jan 17, 2023 •
edited
Loading

Hello,
after downloading the data from Zenodo and trying to retrain the Benchmarks, I get file not found errors.
rasterio.errors.RasterioIOError: --path--/lr_dataset/ASMSpotter-1-1-1/L2A/: No such file or directory
As it turns out, the folder 'ASMSpotter-1-1-1' is not in the dataset even though the download was successful and the checksums were correct. Any ideas how that can happen?

Edit: The above mentioned folder is indeed the only one missing, removing this line form the stratified_train_val_test_split.csv file allows the training to continue.
@jucor
Copy link
Contributor

jucor commented Jan 17, 2023

Thanks a lot for flagging this! We re downloading the repo to reproduce and fix :) Please bear with us.

@ivanorsolic
Copy link
Collaborator

Hi @simon-donike, thank you for raising the issue, I confirm I can reproduce it by downloading from Zenodo.
I can also confirm I have located the missing data, and am working on a fix to make it available.

The repo will be getting some updates in the coming weeks, and I will make it a priority to at least provide a downloadable zip with the missing data. After that, I'll work on rebuilding and reupload a patched archive, which takes a bit (lots of data!).

@ivanorsolic ivanorsolic added the in progress The issue is acknowledged and being solved. label Feb 6, 2023
@nilsleh
Copy link

nilsleh commented Jan 30, 2025

@ivanorsolic @jucor Is there any update on this? I am also encountering this.

@jucor
Copy link
Contributor

jucor commented Jan 30, 2025

Thanks for chasing, @nilsleh ! Since there's only two of us attempting to maintain on the side of now completely unrelated jobs, plus "real life stuff", we're a "little" behind. @ivanorsolic has been working hard on a proper fix that we need to upload (we wanted to do a few more checks before doing so), but there are few non-Worldstrat things that got in the way (morale of the story: push early, even if not done testing?).
TLDR: We have not forgotten this bug, and we'll push the fix as soon as we can (couple weeks maybe?).

@nilsleh nilsleh linked a pull request Feb 3, 2025 that will close this issue
Open
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@ivanorsolic ivanorsolic

Labels
in progress The issue is acknowledged and being solved.
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Add WorldStrat dataset nilsleh/torchgeo
4 participants
@jucor @ivanorsolic @nilsleh @simon-donike