Skip to content

Feat: enable new modal gpus 🚀 #286

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 2 commits into
base: main
Choose a base branch
from
Open

Feat: enable new modal gpus 🚀 #286

wants to merge 2 commits into from

Conversation

S1ro1
Copy link
Collaborator

@S1ro1 S1ro1 commented May 30, 2025

Enable H200 + B200 for Modal

@Copilot Copilot AI review requested due to automatic review settings May 30, 2025 22:03
Copy link
Contributor

@Copilot Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull Request Overview

This PR enables support for new modal GPUs for the application.

  • Updated the GPU list in modal_runner_archs.py to include B200 and H200.
  • Added H200 to the ModalGPU enum and its ranking criteria in consts.py.

Reviewed Changes

Copilot reviewed 2 out of 2 changed files in this pull request and generated no comments.

File Description
src/discord-cluster-manager/modal_runner_archs.py Updated GPU list to include new GPU identifiers for modal execution.
src/discord-cluster-manager/consts.py Added H200 to the ModalGPU enum and its corresponding rank mapping.

@@ -115,6 +116,7 @@ class RankCriterion(Enum):
"L4": "80",
"A100": "80",
"H100": "90a",
"H200": "90a",
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

should we enable H200 tho?

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Don't have a strong opinion, probably not too interesting GPU so idc if we remove.

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

yeah'd rather we remove

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants