-
Notifications
You must be signed in to change notification settings - Fork 233
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Serving errors: deprecated dependencies and structure error #103
Comments
There was some misunderstanding; I should have used
|
Sorry for reopen, I thought it'd be better to keep this opened until the dependency deprecation is solved. |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
When I try to serve LLaMA with
v3_8
TPU as suggested in example script, there were some errors.Environment
v3-8
tpu-vm-base
Command
1. Deprecation warning
These can be solved by adding 2 lines to
tpu_requirements.txt
I was able to solve this by deleting
concurrency_count=1
inserving.py
, line 403.According to Gradio v4.0.0 changelog,
concurrency_count
is removed and can be replaced withconcurrency_limit
. As I'm not exactly understanding what it supposed to do and it's set to 1 by default, I just removed it.2. Structure error
However, when I solve deprecation errors above, this error appears:
Error Log
It seems like something went wrong with
"params"
loading at functionload_trainstate_checkpoint
incheckpoint.py
, but I couldn't figure where.Is there someone who knows what's wrong?
The text was updated successfully, but these errors were encountered: