New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

No output when using tensor_parallel #128

Open

yyya9 opened this issue Oct 27, 2023 · 1 comment

yyya9 commented Oct 27, 2023

Author

yyya9 commented Oct 27, 2023

HI, I want to inference vicuna-13b with tensor_parallel, but output is nothing even I wait for 10+h.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment