Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Offload Shuttle data #858

Open
10d9e opened this issue Jan 10, 2023 · 2 comments
Open

Offload Shuttle data #858

10d9e opened this issue Jan 10, 2023 · 2 comments
Labels
New Feature Issues that we will work on with people or ourselves

Comments

@10d9e
Copy link
Contributor

10d9e commented Jan 10, 2023

Depends on #855

Once a root SP has been established, all of the shuttle data should be offloaded to it, and shuttle data should be emptied.
At this point, shuttles have to be reconfigured as temporary stores that immediate delete their data as soon as the 6+1 deals have been executed.

@10d9e 10d9e added the New Feature Issues that we will work on with people or ourselves label Jan 10, 2023
@10d9e 10d9e added this to the Retrievals Q1 milestone Jan 10, 2023
@jcace
Copy link
Contributor

jcace commented Jan 10, 2023

I wonder if we should do this in a phased approach, by first offloading to our existing SP network. We could examine:

  • Which CIDs are least-frequently retrieved
  • Of those infrequently-accessed CIDs, how many are presently retrievable from SPs (if 5/6 or 6/6, perhaps we can already offload them)

@alvin-reyes
Copy link
Contributor

It should be in phases.

We need to ensure that the CIDs are retrievable in any other "retrieval" providers before we offload. If we can prove this (by pinging?) the retrieval providers, we can delete the CID/content from the blockstore and store the meta information on our database. We should store where the user can look up the CID and we can present it on the frontend.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
New Feature Issues that we will work on with people or ourselves
Projects
Status: No status
Development

No branches or pull requests

3 participants