Skip to content

How to train on other documentation

Alex edited this page Feb 4, 2023 · 21 revisions

How to train on other documentation

This AI can use any documentation, but first it needs to be prepared for similarity search.

Start by going to /scripts/ingest_rst.py

If you open this file you will see that it uses rst files from the folder to create a docs.index and faiss_store.pkl.

It currently uses OPEN_AI to create vector store, so make sure your documentation is not too big. Pandas cost me around 3-4$

1. Find documentation in .rst and create a folder with it in your scripts directory

You can usually find it on github in docs/ folder for most open-source projects. If anyting just conver whatever you find to txt and feed it.

2. Run scripts/ingest.py

python ingest.py

3. Move docs.index and faiss_store.pkl files to application folder.

4. Run web app

Once you run it will use new context that is relevant to your documentation

Clone this wiki locally