Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Real Memory summary for on-going conversations (avoid LLM size limits) #694

Open
Isaac4real opened this issue Feb 18, 2025 · 1 comment
Open
Labels
enhancement New feature or request

Comments

@Isaac4real
Copy link

Is your feature request related to a problem? Please describe.
the framework has basic truncation and message removal, but NO built-in summarization to manage long-term memory growth. It will eventually break if the memory exceeds the LLM's context window. This is a significant area for improvement.

Describe the solution you'd like
Memory management capable of creating long-term memories (convert older messages into a short summary/facts version). Limit the memory to only last e.g. 100 memories. For older memories, use RAG to retrieve any relevant memory if at all.

Is this not possible with the current options.
this kind of memory management is not possible natively in smolagents

Describe alternatives you've considered
I've developed my own external memory management for long-term memories. but it's a pain to keep it in sync with the main repo version

Additional context
somehow similar issue here: #531

@Isaac4real Isaac4real added the enhancement New feature or request label Feb 18, 2025
@wgabrys88
Copy link

Yeah, another must have feature to even consider smolagents to be usefull...

In theory seems easy, just output in the first iteration a summarization of what was already tried and make sure that the printout is easily noticeable by "second round" - also working on this, maybe we can sync?

BTW, share you solution, maybe it is not you who has to follow to be in sync, it may be the other way ;)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants