Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Serving DNN Models with Multi-Instance GPUs: A Case of the Reconfigurable Machine Scheduling Problem #284

Open
gaocegege opened this issue Nov 29, 2021 · 1 comment
Open

Serving DNN Models with Multi-Instance GPUs: A Case of the Reconfigurable Machine Scheduling Problem #284

gaocegege opened this issue Nov 29, 2021 · 1 comment
Labels
area/distributed-systems area/GPU type/paper

Comments

@gaocegege
Copy link
Member

https://arxiv.org/abs/2109.11067

利用 A100 MIG 进行模型 serving 的探索

字节 MLSys 组
@gaocegege
Copy link
Member Author

比较无聊，除了附录之外其他的随便看看就好

附录比较有价值，它做了完整的实验来对比不同的模型在不同的 A100 MIG GI/CI config 下的表现。

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
area/distributed-systems area/GPU type/paper
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@gaocegege