New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked #493

Open

EmmaGuo910 opened this issue Jan 21, 2021 · 1 comment

EmmaGuo910 commented Jan 21, 2021 •

edited

Loading

I found create_table_from_csv is too slow. I tried to use multiprocessing, but there is a lock of database, how should I do

thanks

pdsparks commented Apr 12, 2021

Hi - I believe that sqlite write-locking will prevent multi process inserts.

If you are trying to generate a table for one-off data exploration I would use a free program like HeidiSQL (Tools - Import CSV)

If you are looking to automate an import process then maybe try checking this Stack response [here] (https://stackoverflow.com/questions/6977497/import-csv-file-into-sqlite3-database-in-command-line-or-via-batch-file)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment