Error when changing from GPT-4o mini to Phi-3-mini

[thyarles]

Select Topic Area

Bug

Body

I just tested the environment for the first time.

1. Using GPT-4o mini I interacted a little, only three small questions.
2. Then I changed to Phi-3-mini and typed just a "Hi there!".

Result: I got this context length error:

[github-actions[bot]]

💬 Your Product Feedback Has Been Submitted 🎉

Thank you for taking the time to share your insights with us! Your feedback is invaluable as we build a better GitHub experience for all our users.

Here's what you can expect moving forward ⏩

• Your input will be carefully reviewed and cataloged by members of our product teams. 
  • Due to the high volume of submissions, we may not always be able to provide individual responses.
  • Rest assured, your feedback will help chart our course for product improvements.
• Other users may engage with your post, sharing their own perspectives or experiences. 
• GitHub staff may reach out for further clarification or insight. 
  • We may 'Answer' your discussion if there is a current solution, workaround, or roadmap/changelog post related to the feedback.

Where to look to see what's shipping 👀

• Read the Changelog for real-time updates on the latest GitHub features, enhancements, and calls for feedback.
• Explore our Product Roadmap, which details upcoming major releases and initiatives.

What you can do in the meantime 💻

• Upvote and comment on other user feedback Discussions that resonate with you.
• Add more information at any point! Useful details include: use cases, relevant labels, desired outcomes, and any accompanying screenshots.

As a member of the GitHub community, your participation is essential. While we can't promise that every suggestion will be implemented, we want to emphasize that your feedback is instrumental in guiding our decisions and priorities.

Thank you once again for your contribution to making GitHub even better! We're grateful for your ongoing support and collaboration in shaping the future of our platform. ⭐

[Akash1134]

Hi @thyarles ,

Could you please check if this issue still persists? There might be a chance that you actually hit the token rate limit.

Note that the playground and free API usage are rate limited by requests per minute, requests per day, tokens per request, and concurrent requests. If you get rate limited, you will need to wait for the rate limit that you hit to reset before you can make more requests.

Low, high, and embedding models have different rate limits. To see which type of model you are using, refer to the model's information in GitHub Marketplace or see the Docs.

Thanks!

[thyarles]

Hi @Akash1134,

Thanks for your update. I just tried the same experiment again, same error. I can't tell if I'm getting any rate limits, as only four questions were asked until I get the error. I'll attach the before and after if you want to try it.

1. First, I start with a set of three small questions with an odd instruction:
   

2. Next I change the model and just say hi there, then I got the error.
   

Can't say if I'm doing anything wrong. If so, please, let me know.

[matthewisabel]

Thanks for the report again, definitely looks like a bug and we're looking into it!

[matthewisabel]

This should be fixed!