You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I noticed upon testing today that the MUR SST icechunk store I created and previously demonstrated as working in https://github.com/earth-mover/icechunk-nasa/blob/main/notebooks/read_virtual.ipynb has been corrupted in someway. It's unclear when and how (I had an inconclusive slack conversation with Seba about this), and my only guess is that opening the store with a later version than it was created with somehow corrupts the data. Seba did confirm that the on disk format changes between pre-stable release versions (such as alpha12 and alpha15)
I'm not sure it's worth the time, given I think icechunk is nearing a stable release, but it would be nice to investigate in a toy example if my guess is correct and that reading with a later version corrupts the store.
The text was updated successfully, but these errors were encountered:
@sharkinsspatial @maxrjones - I am just tagging you on this as an FYI since I asked you to review earth-mover/icechunk-nasa#4
I noticed upon testing today that the MUR SST icechunk store I created and previously demonstrated as working in https://github.com/earth-mover/icechunk-nasa/blob/main/notebooks/read_virtual.ipynb has been corrupted in someway. It's unclear when and how (I had an inconclusive slack conversation with Seba about this), and my only guess is that opening the store with a later version than it was created with somehow corrupts the data. Seba did confirm that the on disk format changes between pre-stable release versions (such as alpha12 and alpha15)
You can see the traceback for the error
IcechunkError: store error: unsuccessful session operation:
Repository error: error contacting storage error getting object from object store service error`` in this gist: https://gist.github.com/abarciauskas-bgse/ddfb19f02f3018df191c9ec8ade67765.I'm not sure it's worth the time, given I think icechunk is nearing a stable release, but it would be nice to investigate in a toy example if my guess is correct and that reading with a later version corrupts the store.
The text was updated successfully, but these errors were encountered: