GitHub Community
How does Github Models Rate-Limiting work #137298
-
Select Topic AreaQuestion BodyGPT 4o mini has a rate limit of 150/day |
Beta Was this translation helpful? Give feedback.
Replies: 2 comments 1 reply
-
|
Yes, you can use a total of 200 requests per day if you combine the rate limits of GPT-4o mini (150/day) and GPT-4o (50/day). However, if each of the 25 models has its own rate limit, then theoretically, you could make up to 2000 requests per day (25 models * 80 requests/day). But this depends on the specific rate limits set for each model and whether they can be combined in this way. |
Beta Was this translation helpful? Give feedback.
-
|
Thank you for clarifying that. Also is there a way to get the usage dynamically (from my Python script)? I know that it is possible to count each request sent, but is there a better way? |
Beta Was this translation helpful? Give feedback.
This comment was marked as off-topic.
This comment was marked as off-topic.
Yes, you can use a total of 200 requests per day if you combine the rate limits of GPT-4o mini (150/day) and GPT-4o (50/day).
However, if each of the 25 models has its own rate limit, then theoretically, you could make up to 2000 requests per day (25 models * 80 requests/day). But this depends on the specific rate limits set for each model and whether they can be combined in this way.