CE 602/rag project implementation

[C00ldudeNoonan]

Summary & Motivation

Creating a relatively simple use-case of doing a RAG in Dagster. This project attempts to replicate the ask-ai functionality and scrapes the docs site and github issues and discussions, adds them to a pinecone vectordb. Then there is a query asset that takes in some config information in the form of a query and then returns a response in the Dagster UI

How I Tested These Changes

Definitions loaded properly and assets all materialized.

[dehume]

This is really cool. I have to do a more detailed review but left some high level suggestions.

Also since there is some overlap with the Pinecone example I was working on. I think it might be better to go forward with this one as our RAG example and I can repurpose mine as an AI fine-tuning example.