How to load large datasets? Corrupted database #2043
Unanswered
hosting2000me
asked this question in
Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
I'm trying to load a large amount of data into the database (several hundred million entries). I'm doing this in batches. However, I discovered that there is a limit on the batch size of 1024. I found where to change this limit through a Go program. But after I increased the batch size and started uploading batches with more elements (e.g., 5000 entries), I ended up with a corrupted database that refused to load.
Beta Was this translation helpful? Give feedback.
All reactions