triton支持 #123
Unanswered
situjunhao
asked this question in
Q&A
triton支持
#123
Replies: 2 comments 2 replies
-
|
可否展开说说为什么要使用triton这个工具呢？有什么优势啊？ |
Beta Was this translation helpful? Give feedback.
2 replies
-
|
triton就是用来部署onnx或者是tensorrt的，tensorrt仅仅支持GPU，nvidia对tensorrt有算子优化，合并加速，比原始的torch模型，onnx都要更快 |
Beta Was this translation helpful? Give feedback.
-
|
这是我网上找的说明链接：https://cloud.tencent.com/developer/article/2126650 |
Beta Was this translation helpful? Give feedback.
-
|
收到，我有空看看。 |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
大佬，ONNX都有了，怎么配置到triton使用？
Beta Was this translation helpful? Give feedback.
All reactions