Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Corrupted dlt pipelines metadata #2394

Open
dexters1 opened this issue Mar 11, 2025 · 0 comments
Open

Corrupted dlt pipelines metadata #2394

dexters1 opened this issue Mar 11, 2025 · 0 comments

Comments

@dexters1
Copy link

dlt version

1.7.0

Describe the problem

I've somehow managed to corrupt my dlt metadata at: "/Users/{username}/.dlt/pipelines" ( I don't know how )

Due to this dlt stopped creating it's tables in databases and I was getting the following error:

"(sqlite3.OperationalError) no such table: main._dlt_loads"

I had a hard time debugging what was the problem with my dlt afterwards as reinstalling dlt with pip, making fresh environments and etc. didn't help. When I manually deleted the dlt pipelines data dlt managed to work again.

Maybe consider also removing this pipeline data when dlt in uninstalled? Or maybe have a suggestion to clean this dlt pipelines metadata in the traceback message.

It's not an easy issue to find, debug and resolve for users currently.

Expected behavior

No response

Steps to reproduce

Corrupt the dlt pipelines metadata at: "/Users/username/.dlt/pipelines"

Operating system

macOS

Runtime environment

Local

Python version

3.12

dlt data source

No response

dlt destination

No response

Other deployment details

No response

Additional information

No response

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
Status: Todo
Development

No branches or pull requests

1 participant