Skip to content

Commit

Permalink
remove template match, fix ixc25 video doc
Browse files Browse the repository at this point in the history
  • Loading branch information
dillonalaird committed Aug 24, 2024
1 parent 416ae38 commit 6129d19
Showing 1 changed file with 11 additions and 1 deletion.
12 changes: 11 additions & 1 deletion vision_agent/tools/tools.py
Original file line number Diff line number Diff line change
Expand Up @@ -551,8 +551,19 @@ def ixc25_video_vqa(prompt: str, frames: List[np.ndarray]) -> str:
including regular videos or videos of documents or presentations. It returns text
as an answer to the question.
Parameters:
prompt (str): The question about the video
frames (List[np.ndarray]): The reference frames used for the question
Returns:
str: A string which is the answer to the given prompt.
Example
-------
>>> ixc25_video_vqa('Which football player made the goal?', frames)
'Lionel Messi'
"""

buffer_bytes = frames_to_bytes(frames)
files = [("video", buffer_bytes)]
payload = {
Expand Down Expand Up @@ -1542,7 +1553,6 @@ def overlay_heat_map(
overlay_bounding_boxes,
overlay_segmentation_masks,
overlay_heat_map,
template_match,
]
TOOLS_DF = get_tools_df(TOOLS) # type: ignore
TOOL_DESCRIPTIONS = get_tool_descriptions(TOOLS) # type: ignore
Expand Down

0 comments on commit 6129d19

Please sign in to comment.