-
Notifications
You must be signed in to change notification settings - Fork 2k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Throttling and rate limiting on non LLM API calls #615
Comments
Just read the docs its right there https://docs.crewai.com/core-concepts/Agents/#agent-attributes |
@noggynoggy thanks for your answer !! Actually, as I mentioned in my message, I don't think that the "max_rpm" attribute in the documentation is a good fit for my problem because:
Is there something that I missed ? |
I am sorry - I do not seem to understand what you want to throttle. Do you mean like "x about of tokens per x amount of time"? I don't know what "my end APIs" is. |
I'm using tools that make calls to third-party APIs like:
In case it's not clear what I mean by API rate limiting vs. API throttling, here is an article that talks about it: API Rate Limiting vs. API Throttling: How Are They Different? Company Search (Rate Limiting)My API has an X requests per minute limit, so I can't use it more than that. I need to put a limit on tasks, not on agents, for this. Sending Emails (Throttling)I can send as many emails as I want, but if I don't put some delay between each email, I will get flagged as spam. I would need to add throttling on tasks for this. |
I use API that have rate limits and others that need throttling.
What is the right way to this ?
I feel like the Max RPM parameter on the Agent is not a good fit because it seems focused on the number of LLM calls.
The text was updated successfully, but these errors were encountered: