Skip to content

Example code for a basic Long Term Memory Chatbot using Qdrant and a conversation history list.

License

Notifications You must be signed in to change notification settings

libraryofcelsus/Qdrant-Long-Term-Memory-Chatbot

Repository files navigation

Qdrant-Long-Term-Memory-Chatbot

Example code for a basic Long Term Memory Chatbot using Qdrant and a conversation history list.

If you find this code useful, consider checking out my main Ai Assistant project: https://github.com/libraryofcelsus/Aetherius_AI_Assistant

If you want more code tutorials like this, follow me on github and youtube: https://www.youtube.com/@LibraryofCelsus

(Channel isn't launched yet, I have multiple scripts like this written, but am still working on a video production format. Subscribe for its Launch!)

In-Depth Code Tutorials in a documentation format available at: https://www.libraryofcelsus.com/research/public/code-tutorials/

Window's Installation

  1. If using Qdrant Cloud copy their Api key and Url to the corresponding .txt files.
    Qdrant Cloud Link: https://qdrant.to/cloud
    To use a local Qdrant server, first install Docker: https://www.docker.com/, then see: https://github.com/qdrant/qdrant/blob/master/QUICK_START.md
    Once the local Qdrant server is running, it should be auto detected by the script.
  2. Install Git
  3. Install Python 3.10.6, Make sure you add it to PATH
  4. Open Git Bash Program
  5. Run git clone: git clone https://github.com/libraryofcelsus/Basic-Long-Term-Memory-Chatbot.git
  6. Open the Command Line as admin and navigate to the project install folder with cd
  7. Create a virtual environment: python -m venv venv
  8. Activate the virtual enviornment with: .\venv\Scripts\activate
  9. Install the requirements with pip install -r requirements.txt
  10. Edit and set your username and chatbot name in the .txt files
  11. Edit and set your main prompt and greeting in the .txt files
  12. For Oobabooga: Install the Oobabooga Web-Ui. This can be done with a one-click installer found on their Github page: https://github.com/oobabooga/text-generation-webui. Then launch the Web-Ui and navigate to the sessions tab, click both Api boxes and then click apply and restart. Now navigate to the models tab and enter: "TheBloke/Llama-2-7b-Chat-GPTQ" or "TheBloke/Llama-2-13B-chat-GPTQ". (If using cpu use the GMML Version) Once the model is downloaded, change the Model loader to ExLlama and set the gpu-split parameter to .5gb under your GPU's limit. Next set the max_seq_len to 4096.
  13. For OpenAI: Add your OpenAi Api Key to key_openai.txt
  14. Run the chatbot with python Script_Name.py

*Note, you will need to run .\venv\Scripts\activate every time you exit the command line to reactivate the virtual enviornment.


My Ai research is self-funded, consider supporting me if you find it useful :)

Buy Me a Coffee at ko-fi.com


Contact

Discord: libraryofcelsus -> Old Username Style: Celsus#0262

MEGA Chat: https://mega.nz/C!pmNmEIZQ

Email: [email protected]

About

Example code for a basic Long Term Memory Chatbot using Qdrant and a conversation history list.

Topics

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Languages