Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Ma/add claude sonnet 3.5 #172

Merged

Conversation

moutasemalakkad
Copy link
Contributor

I have included Sonnet. For reference, here are the doc

https://docs.anthropic.com/en/docs/build-with-claude/vision

@dillonalaird dillonalaird self-requested a review July 18, 2024 16:20
Copy link
Member

@dillonalaird dillonalaird left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Few comments, also when I run it with images it looks like it's not able to see the image

lmm([{"role": "user", "content": "describe this image", "media": ["construction-site.jpg"]}])
>>> "I'm sorry, but you have not uploaded an image for me to analyze yet. Please upload an image and I will be happy to describe it for you."

vision_agent/lmm/lmm.py Outdated Show resolved Hide resolved
vision_agent/lmm/lmm.py Outdated Show resolved Hide resolved
@moutasemalakkad
Copy link
Contributor Author

moutasemalakkad commented Jul 18, 2024

@dillonalaird should be working now

print(lmm([{"role": "user", "content": "describe this image", "media": ["/Users/moutasemhome/Desktop/personal/10431293_10153011295899848_6946328875290775609_o.jpg"]}]))






INFO:httpx:HTTP Request: POST https://api.anthropic.com/v1/messages "HTTP/1.1 200 OK"
This image shows a group selfie of three people in an outdoor setting surrounded by trees and a lake or pond in the background. The person in the center, an older man wearing glasses and a black shirt, is smiling widely at the camera. On either side of him are a young woman with short hair wearing a teal jacket and a man with a beard wearing a red shirt. They all have friendly, happy expressions and appear to be enjoying their time together in this scenic natural environment.

Copy link
Member

@dillonalaird dillonalaird left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM thanks!

@dillonalaird dillonalaird merged commit a5181e7 into landing-ai:main Jul 19, 2024
8 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants