Hi, I'm trying to use Vertex AI API via newAPI

[acc4github]

I'm trying to use gemini models in SillyTavern(https://github.com/SillyTavern/SillyTavern) from the Google Vertex API. SillyTavern doesn't officially support Vertex, so I'm looking for a way to convert it into OpenAI-compatible format. Is it possible to use NewAPI for this purpose? Or am I knocking on the wrong door? :>

[Calcium-Ion]

Your use case is perfectly viable! New-API supports integrating Google Vertex API's Gemini models into SillyTavern.

New-API can serve as a middleware layer that converts Vertex API requests and responses into OpenAI-compatible format, allowing you to use Gemini models in SillyTavern. This is actually one of the core purposes of New-API - providing a unified interface to access different AI models.

You can set up New-API as a proxy, then configure the OpenAI interface in SillyTavern to point to your New-API address. This will enable you to seamlessly use Gemini models in SillyTavern.

[acc4github]

If you have time, can you maybe briefly explain how to use it step by step in NewAPI for a newbie user like me? I'm not really a tech-oriented person, and I'm struggling to figure things out. (Also because the UI language is mostly Chinese) :'>
I have downloaded the Vertex API json file ready, and opened the NewAPI in the browser.

[zeta-techs]

Yes you can, I already succesfully did this, through openai-compatible format, address: https://your-newapi-address/v1

[zeta-techs]

Did I do it right?

1. Create a channel following your instructions
2. Create API token in the API Token tab
3. Set the SillyTavern's Connection Profile using the https://your-newapi-address/v1 and the generated API token key
   

It gives me error :'>

Any advice is appreciated. (I hope I'm not bothering you..)

Actually the address https://your-newapi-address/v1 means the address you access your new-api website, such as http://localhost:3000, and you add /v1 to the end of the address.

So, you should modify the address to your own (make sure your sillytavern project able to access your new-api address)

For example, my new-api address is: https://api.zetatechs.com , for sillytavern project I should fill https://api.zetatechs.com/v1

[acc4github]

The text message is working now, but it doesn't give me the actual response in the chat. :'>

SillyTavern CMD log:

[acc4github]

Also, both NewAPI and SillyTavern give a different error when I tried to use different models (gemini-2.0-flash-exp)

[acc4github]

Update: The original model I wanted to use(gemini-2.5-pro-exp-03-25) worked when I used a different prompt preset. I suppose it's a prompt issue. :D
But the second error("the ratio or price not set, please set or start self-use mode") still occurs.

[Calcium-Ion]

enable this