Send batch of requests ASAP #3596
-
Hello, I'm trying to figure out the correct way to use LiteLLM in my use case. Then I'm using the following code to execute the requests:
Ideally I want to run the requests successfully as fast as possible and if there are any errors on the way, retry, cooldown a number of times. Currently it doesn't look to me like it's obeying any of the keywords I set like cooldown, retry_after, num_retries & allowed_fails. |
Beta Was this translation helpful? Give feedback.
Replies: 1 comment
-
Live here: #3751 @anterart can we hop on a call sometime this week to learn how we can improve litellm for you ? What's the best email to send an invite to ? If it's easier here's my cal: https://calendly.com/d/4mp-gd3-k5k/litellm-1-1-onboarding-chat |
Beta Was this translation helpful? Give feedback.
Live here: #3751
@anterart can we hop on a call sometime this week to learn how we can improve litellm for you ? What's the best email to send an invite to ?
If it's easier here's my cal: https://calendly.com/d/4mp-gd3-k5k/litellm-1-1-onboarding-chat