[Enhancement]: Running Claude Sonnet V2 by Google VertexAI

[rmuilwijk]

What features would you like to see added?

Currently when running Claude Sonnet V2 by google vertex will create a default google genai client instead of the anthropic vertexai sdk. This does not allow you use function calls etc. Also there is no notion of token limits etc. which need to be configured to run the model.

More details

https://docs.anthropic.com/en/api/claude-on-vertex-ai

Which components are impacted by your request?

Endpoints

Pictures

No response

Code of Conduct

• I agree to follow this project's Code of Conduct

[Hashiraee]

I’d also very much want this.

[kartikay-bagla]

@danny-avila I am interested in working on this feature.

From my understanding, I can get started with modifying the publisher const in GoogleClient.js to use anthropic and see if the claude models work. Once I can confirm that only changing the publisher value is enough, we can discuss how to enable this in user config when specify models. We can also try to support other publishers on VertexAI through this.

Any ideas on how we can get the user config to support different publishers and models?

Also, just confirming that there isn't anyone else working on this issue to avoid duplicate work.