You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Currently Anthropic models on AWS Bedrock is supported but not Google Vertex.
"As a user of Inspect eval framework and also GCP, I'd like to use Anthropic models through Vertex AI in the Google Cloud project and region of my choice, rather than having to create a new billing process to use through the Anthropic API"
I don't have access to Vertex to test, however I just made a change that should enable you to put together a PR for this. The Anthropic client already supports Bedrock, and I just made it possible to use an anthropic/bedrock/ model name prefix to opt into using this client: ca04ef5
Anthropic also has a built-in Vertex client, so you could add a vertex flag (and service name check) that binds to Vertex rather than Bedrock or the default Anthropic endpoint.
Currently Anthropic models on AWS Bedrock is supported but not Google Vertex.
"As a user of Inspect eval framework and also GCP, I'd like to use Anthropic models through Vertex AI in the Google Cloud project and region of my choice, rather than having to create a new billing process to use through the Anthropic API"
Details on all anthropic models:
https://docs.anthropic.com/en/docs/about-claude/models
The text was updated successfully, but these errors were encountered: