Custom context size for local models #2586
gelim
started this conversation in
Feature Requests & Suggestions
Replies: 1 comment 1 reply
-
Yes, this week there will be a solution for this. |
Beta Was this translation helpful? Give feedback.
1 reply
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Hello,
I'm stumbling on the 4096 context size limit on local models served via litellm.
Is there a way/plan to support custom context size limit?
Cheers
Beta Was this translation helpful? Give feedback.
All reactions