Skip to content

Commit

Permalink
more docs for ollama
Browse files Browse the repository at this point in the history
  • Loading branch information
dillonalaird committed Aug 27, 2024
1 parent d00c460 commit c14f147
Showing 1 changed file with 12 additions and 0 deletions.
12 changes: 12 additions & 0 deletions vision_agent/lmm/lmm.py
Original file line number Diff line number Diff line change
Expand Up @@ -333,6 +333,18 @@ def __init__(
num_ctx: int = 128_000,
**kwargs: Any,
):
"""Initializes the Ollama LMM. kwargs are passed as 'options' to the model.
More information on options can be found here
https://github.com/ollama/ollama/blob/main/docs/modelfile.md#valid-parameters-and-values
Parameters:
model_name (str): The ollama name of the model.
base_url (str): The base URL of the Ollama API.
json_mode (bool): Whether to use JSON mode.
num_ctx (int): The context length for the model.
kwargs (Any): Additional options to pass to the model.
"""

self.url = base_url
self.model_name = model_name
self.kwargs = {"options": kwargs}
Expand Down

0 comments on commit c14f147

Please sign in to comment.