onnxruntime-gpu服务部署后,显卡逐渐增大,当请求完成或者停止后,显存不下降 #403
yiluzhuimeng
started this conversation in
General
Replies: 1 comment
-
解决了吗? |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
onnxruntime-gpu 1.19.2
cuda 12.4
torch 2.4.1
onnxruntime-gpu服务部署后,显卡逐渐增大,当请求完成或者停止后,显存不下降
Beta Was this translation helpful? Give feedback.
All reactions