Why is very slow?

[George166382]

I entered a prompt in hosted gpt and I've been waiting for 7 minutes and still no answer.

[krschacht]

Hi @George166382, I definitely want to get this fixed for you. It should reply really quickly. My first hunch is that maybe there is an issue with the API key but it's not displaying a clean error message? That's just an initial guess so try double-checking the API key that you've entered into settings to make sure it's correct with what you see in OpenAI or Anthropic. But to help track down and fix the issue for you, let me ask:

1. Are you running this locally or are you running it on Render?
2. Are you using OpenAI (GPT-4) or Anthropic (Claude 3)?
3. Can you watch the server logs while you try a chat message to let me know if there is an error that you see in the logs?

[George166382]

These are some errors that I've found in logs.

[krschacht]

@George166382 Ah, okay, well the bug for me is that this error message should have been detected and surfaced to you within the chat experience. I'll work on getting that fixed.

In terms of getting it resolved, I initially thought your API key may have been invalid (such as copying & pasting but leaving off the last character) but I believe this reports a different error when that's the case. It would say "invalid key" or something like that. So I suspect you just need to configure your billing at OpenAI.

I think you need to go to this page: https://platform.openai.com/account/billing/overview and either add credits to your account or turn on auto-recharge and then it'll automatically bill you when you need more API credits.

Let me know if this resolves it for you. Meanwhile, I'll try to improve this error scenario. Ideally it should detect this and even suggest this resolution.

[George166382]

Here?

[krschacht]

Yep! You'll need to "Add payment details" and put a credit card on file with them. I think that alone should fix it. I notice I have "auto-recharge" off for my account and it appears to be working fine.

[George166382]

Thank you ! Problem solved.

[krschacht]

I just pushed a new commit to the project which detects this issue and displays a nice error message for future people:

(Received a quota error. Your API key is probably valid but you may need to adding billing details. You are using #{service} so go here #{url} and add a credit card, or if you already have one review your billing plan.)