We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
I config:
This config can be deployed successfully and when I send request to model, response is nothing. api_base: refer https://developers.cloudflare.com/workers-ai/configuration/open-ai-compatibility/
No log.
No response
The text was updated successfully, but these errors were encountered:
what do your logs say when you run the proxy with --detailed_debug ? @tuanlv14
--detailed_debug
Sorry, something went wrong.
No branches or pull requests
What happened?
I config:
litellm_params:
model: cloudflare/@hf/thebloke/deepseek-coder-6.7b-instruct-awq
api_base: https://api.cloudflare.com/client/v4/accounts/my_acc_id/ai/v1/
api_key: my_CLOUDFLARE_API_KEY
rpm: 100
This config can be deployed successfully and when I send request to model, response is nothing.
api_base: refer https://developers.cloudflare.com/workers-ai/configuration/open-ai-compatibility/
Relevant log output
Twitter / LinkedIn details
No response
The text was updated successfully, but these errors were encountered: