panic: Unrecognized schema: map[]

[VitaminTe]

Hello - I'm unable to get this integration to work with a localai server. The server itself works just fine but as soon as I try and call it from home assistant with this integration I get the following error following by my container crashing: panic: Unrecognized schema: map[]

There is an open ticket on localai written by someone else with the same issue and others have chimed in. That said everything works fine when I use llama conversion.

Sorry I'm a newbie to all of this but if there is anything I can provide to help trouble shoot I'm happy to.

[maxi1134]

It works if we set the functions to 0.

More details here:

mudler/LocalAI#2223

[R3dC4p]

looks like a user on youtube had it working some time ago with a specific model: https://www.youtube.com/watch?v=pAKqKTkx5X4

TheBloke/Luna-AI-Llama2-Uncensored-GGUF

[R3dC4p]

Pulled a previous release, and it seems to work with the luna ai image... something seems to have broken between february and now, looks like it's on local-ai's end

[VitaminTe]

Pulled a previous release, and it seems to work with the luna ai image... something seems to have broken between february and now, looks like it's on local-ai's end

A previous release of what? LocalAI?

[R3dC4p]

Yes. went back to 2.8.2 based on evidence that it was working as recently as february. tried 2.12.1, and the issue was back, haven't tried the releases between

[maxi1134]

I can confirm that it seems to work with 2.8.2 as said by R3dc4p.
Although it seems to be WAY slower with my 3090 than the latest version.