Skip to content

Commit

Permalink
updated docs
Browse files Browse the repository at this point in the history
  • Loading branch information
dillonalaird committed Apr 25, 2024
1 parent 3bc737b commit 8e3c525
Showing 1 changed file with 14 additions and 7 deletions.
21 changes: 14 additions & 7 deletions vision_agent/agent/vision_agent.py
Original file line number Diff line number Diff line change
Expand Up @@ -473,9 +473,14 @@ def __call__(
"""Invoke the vision agent.
Parameters:
input: a prompt that describe the task or a conversation in the format of
chat: A conversation in the format of
[{"role": "user", "content": "describe your task here..."}].
image: the input image referenced in the prompt parameter.
image: The input image referenced in the chat parameter.
reference_data: A dictionary containing the reference image, mask or bounding
box in the format of:
{"image": "image.jpg", "mask": "mask.jpg", "bbox": [0.1, 0.2, 0.1, 0.2]}
where the bounding box coordinates are normalized.
visualize_output: Whether to visualize the output.
Returns:
The result of the vision agent in text.
Expand Down Expand Up @@ -515,12 +520,14 @@ def chat_with_workflow(
"""Chat with the vision agent and return the final answer and all tool results.
Parameters:
chat: a conversation in the format of
chat: A conversation in the format of
[{"role": "user", "content": "describe your task here..."}].
image: the input image referenced in the chat parameter.
reference_data: a dictionary containing the reference image and mask. in the
format of {"image": "image.jpg", "mask": "mask.jpg}
visualize_output: whether to visualize the output.
image: The input image referenced in the chat parameter.
reference_data: A dictionary containing the reference image, mask or bounding
box in the format of:
{"image": "image.jpg", "mask": "mask.jpg", "bbox": [0.1, 0.2, 0.1, 0.2]}
where the bounding box coordinates are normalized.
visualize_output: Whether to visualize the output.
Returns:
A tuple where the first item is the final answer and the second item is a
Expand Down

0 comments on commit 8e3c525

Please sign in to comment.