Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

cd: workflow for deploying ml pipeline #64

Merged
merged 4 commits into from
Dec 7, 2024
Merged

Conversation

Charlie-XIAO
Copy link
Contributor

@Charlie-XIAO Charlie-XIAO commented Dec 6, 2024

This PR adds the workflow for deploying the pipeline. See README under /deploy/ for more details. It also adds a GitHub action that triggers redeploy of ChromaDB, then reploy of app and pipeline as well.

@Charlie-XIAO
Copy link
Contributor Author

I can confirm that the chromadb database indeed gets updated. It is a bit strange that I got this error from the remote frontend:

Status 500 (Internal Server Error); caused by:

  File "/veritastrial/main.py", line 139, in retrieve
    results = CHROMADB_COLLECTION.query(
              ^^^^^^^^^^^^^^^^^^^^^^^^^^

InvalidCollectionException: Collection c86ffd78-d7e9-49e2-97a5-fd06d6bbe7b9 does not exist.

Probably it's because the collection is determined on backend startup so if the old collection is removed and a new collection is created, even if they have the same name they are different. I think in a future PR I will change to only fix the client connection on startup but dynamically get the collection on query (I don't think it's going to be large overhead).

Also the Github workflows need to be tested.

@Charlie-XIAO Charlie-XIAO merged commit efca2b0 into main Dec 7, 2024
3 checks passed
@Charlie-XIAO Charlie-XIAO deleted the deploy-pipeline branch December 7, 2024 00:19
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant