How can I fix: Received message larger than max #3951
Unanswered
relink2013
asked this question in
Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
The full error is:
Running LocalAI in Docker on Unraid with a Radeon Pro WX9100 using the AIO-hipblas image.
It only seems to happen when Im using a multimodal model and the image I upload is a high resolution. Lower resolution images work perfectly. I don't have this issue with the Ollama docker, even when running larger models.
I was only able to find one issue pertaining to this error, and it looks like the only solution anyone came up with was to adjust the max message size parameter in the code and recompile the docker image. But doing that starts sounding a bit daunting, especially since everything gets more complicated when working with AMD GPUs.
So is the only solution really to recompile the whole image? and if so how do I go about doing that, especially for my GPU?
Beta Was this translation helpful? Give feedback.
All reactions