Skip to content

Commit

Permalink
change context window to 128k
Browse files Browse the repository at this point in the history
  • Loading branch information
dillonalaird committed Aug 26, 2024
1 parent cfea046 commit 553f139
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion vision_agent/lmm/lmm.py
Original file line number Diff line number Diff line change
Expand Up @@ -330,7 +330,7 @@ def __init__(
model_name: str = "llava",
base_url: Optional[str] = "http://localhost:11434/api",
json_mode: bool = False,
num_ctx: int = 4096,
num_ctx: int = 128_000,
**kwargs: Any,
):
self.url = base_url
Expand Down

0 comments on commit 553f139

Please sign in to comment.