You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I am using MacOS, and installed Ollama locally. My objective is to develop an Agent using Langchain, that can take actions on inputs from LLM conversations, and execute various scripts or one-off shell commands.
For agents, LangChain provides an experimental OllamaFunctions wrapper that gives Ollama the same API as OpenAI Functions. This allows you to:
- Bind functions defined with JSON Schema parameters to the model 3
- Call those functions and get JSON output matching the schema 3
- Use this for structured data extraction or other tasks 3
Is this the best way of developing a custom Agent, without using a managed service for LLM? Or is there another mechanism I should be considering?
Under the Agent Types documentation, I don't see any references to Ollama. Perhaps that's because Ollama Functions are an Agent Type that is still experimental, and hasn't been incorporated into the release documentation?
reacted with thumbs up emoji reacted with thumbs down emoji reacted with laugh emoji reacted with hooray emoji reacted with confused emoji reacted with heart emoji reacted with rocket emoji reacted with eyes emoji
-
I am using MacOS, and installed Ollama locally. My objective is to develop an Agent using Langchain, that can take actions on inputs from LLM conversations, and execute various scripts or one-off shell commands.
I asked https://chat.langchain.com about this, and it responded with the following:
https://python.langchain.com/docs/integrations/chat/ollama_functions
Is this the best way of developing a custom Agent, without using a managed service for LLM? Or is there another mechanism I should be considering?
Under the Agent Types documentation, I don't see any references to Ollama. Perhaps that's because Ollama Functions are an Agent Type that is still experimental, and hasn't been incorporated into the release documentation?
Beta Was this translation helpful? Give feedback.
All reactions