Session based chat message store #9328
mariosconsta
started this conversation in
Ideas
Replies: 1 comment
-
Hello... We will probably work on improving memory management in the future. Could you please add your request to this discussion (deepset-ai/haystack-experimental#75) so we can keep track of it? |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
Hello all!
I have a RAG system using Haystack with Milvus and Docling.
Everything is connected together using Open WebUI's Pipeline functionality for the front-end part.
After reading this tutorial, I've added the functionality to insert the conversation history into the LLMs context, which works wonderfully.
My only issue that, if the user creates a new chat, the conversation from the last chat will get loaded as well.
For example
chat_001
chat_002
From Open WebUI we can get session_IDs, so it would be nice if we could control the InMemoryChatMessageStore with different session_ids, and load those instead of just saving chat messages.
Or at least have a way to clear the InMemoryChatMessageStore and load only the chat messages which are provided by Open WebUI as a dictionary.
Beta Was this translation helpful? Give feedback.
All reactions