Local Hosted Models (ollama)

[mishalhossin]

Discussed in #265

^{Originally posted by Dcamy April 26, 2024}
Has anyone been able to get this to work with a local host model? I a have a model I fine tuned for our community and need a way to make it easily accessible so I am thinking a Discord server but I have never messed with Discord bots (or coding honestly. not my department but I wanna have a working example when I pitch it to the devs).

Any info or pointers would be super helpful, thanks