How to set a default budget for all Customers / End-Users?

[Simon-Stone]

I know that I can set a budget and assign Customers/End-Users to it, but I am looking for a way to have every new Customer automatically be assigned to a default budget. Is that an option?

[Simon-Stone]

I found this relevant documentation, but the value litellm_settings.max_end_user_budget does not seem to be respected. The example in the docs does not work as described. Instead, the second call goes through even though the budget is already exceeded.

The value is also not listed in this overview, which makes me think that the setting is no longer supported.

Does anyone know more about this?

[ex-expat]

I was able to get it working using end_user_max_budget instead of max_end_user_budget. I had to look in the source code to find it because the documentation is wrong. That said, it only works for me when using API calls and passing the user in the post request body, I'm not sure how to make it work when using other things like the Open WebUI UI

[Ithanil]

Modify Open WebUI to pass the user id in the request.

[hakastein]

Is there a way to make the litellm_settings.max_end_user_budget option work, or is it simply not supported?

[martenjostmann]

For me max_end_user_budget and end_user_max_budget did not work. What worked is to create a budget via the UI or the API endpoint /budget/new and then set the litellm_settings.max_end_user_budget_id to the created budget ID. This is also documented in the documentation