Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

gpu方式部署,run_server.sh运行时,显卡使用率低,相较于cpu提升很小 #2346

Open
javed119 opened this issue Jan 2, 2025 · 1 comment
Labels
question Further information is requested

Comments

@javed119
Copy link

javed119 commented Jan 2, 2025

Notice: In order to resolve issues more efficiently, please raise issue following the template.
(注意:为了更加高效率解决您遇到的问题,请按照模板提问,补充细节)

❓ Questions and Help

使用启动脚本
nohup bash run_server.sh
--download-model-dir /workspace/models
--model-dir damo/speech_paraformer-large-vad-punc_asr_nat-zh-cn-16k-common-vocab8404-pytorch
--vad-dir damo/speech_fsmn_vad_zh-cn-16k-common-onnx
--punc-dir damo/punc_ct-transformer_cn-en-common-vocab471067-large-onnx
--lm-dir damo/speech_ngram_lm_zh-cn-ai-wesp-fst
--itn-dir thuduj12/fst_itn_zh
--hotword ../../hotwords.txt > logs/funasr.log 2>&1 &
gpu使用率没有变化,1小时音频转写耗时4分钟。
后面尝试使用python funasr_wss_server.py --port 10095测试,同样的音频,转写耗时1分钟,gpu使用率有波动

What is your question?

run_server.sh没有正常调度gpu?

Code

What have you tried?

What's your environment?

  • OS ubuntu22.04
  • Python version:
  • GPU NVIDIA T4
  • CUDA/cuDNN version 11.4:
  • Docker version funasr-runtime-sdk-gpu-0.2.0
  • Any other relevant information:
@javed119 javed119 added the question Further information is requested label Jan 2, 2025
@worm128
Copy link

worm128 commented Jan 2, 2025

是啊,我这用了gpu速度很慢,而且没了流式识别,都是一整段识别的 #2348

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
question Further information is requested
Projects
None yet
Development

No branches or pull requests

2 participants