Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add new cluster DANDI #3866

Merged
merged 10 commits into from
Mar 28, 2024
Merged

Add new cluster DANDI #3866

merged 10 commits into from
Mar 28, 2024

Conversation

GeorgianaElena
Copy link
Member

@GeorgianaElena GeorgianaElena commented Mar 27, 2024

PHASE 1 and 2 of #3824

@GeorgianaElena GeorgianaElena requested a review from a team as a code owner March 27, 2024 12:24
@GeorgianaElena GeorgianaElena changed the title WIPDandi [WIP] Add new cluster DANDI Mar 27, 2024
Copy link
Member

@yuvipanda yuvipanda left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@GeorgianaElena this lgtm, and I think we should actually merge this if it's been deployed so far - so we can count 'phase 1 and phase 2' as completed.

@@ -28,6 +28,15 @@ local notebookNodes = [
{ instanceType: "r5.xlarge" },
{ instanceType: "r5.4xlarge" },
{ instanceType: "r5.16xlarge" },
{
instanceType: "g4dn.xlarge",
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@yuvipanda should dandi have 2xlarge also like the linc hub?

The cost is ~50% higher (0.75 USD/hour compared to 0.53)

Copy link
Contributor

@consideRatio consideRatio Mar 28, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Ah #3824 (comment) declared that to be the case.

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@consideRatio, I've added 392979c to also support 2xlarge gpu machines. Does that look right to you or should we have only 2xlarge machines?

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@GeorgianaElena yep, we should have both.

Copy link

github-actions bot commented Mar 28, 2024

Merging this PR will trigger the following deployment actions.

Support and Staging deployments

Cloud Provider Cluster Name Upgrade Support? Reason for Support Redeploy Upgrade Staging? Reason for Staging Redeploy
gcp pangeo-hubs Yes Following helm chart values files were modified: support.values.yaml Yes Core infrastructure has been modified
aws jupyter-health Yes Following helm chart values files were modified: support.values.yaml, enc-support.secret.values.yaml Yes Core infrastructure has been modified
aws opensci No Yes Core infrastructure has been modified
aws nasa-ghg No Yes Core infrastructure has been modified
kubeconfig utoronto No Yes Core infrastructure has been modified
gcp qcl No Yes Core infrastructure has been modified
gcp meom-ige No Yes Core infrastructure has been modified
aws 2i2c-aws-us No Yes Core infrastructure has been modified
aws catalystproject-africa No Yes Core infrastructure has been modified
aws ubc-eoas No Yes Core infrastructure has been modified
gcp catalystproject-latam No Yes Core infrastructure has been modified
gcp hhmi No Yes Core infrastructure has been modified
aws smithsonian No Yes Core infrastructure has been modified
aws nasa-veda No Yes Core infrastructure has been modified
gcp linked-earth No Yes Core infrastructure has been modified
gcp awi-ciroh No Yes Core infrastructure has been modified
gcp cloudbank No Yes Core infrastructure has been modified
aws linc No Yes Core infrastructure has been modified
gcp 2i2c-uk No Yes Core infrastructure has been modified
aws gridsst No Yes Core infrastructure has been modified
gcp leap No Yes Core infrastructure has been modified
aws victor No Yes Core infrastructure has been modified
aws openscapes No Yes Core infrastructure has been modified
gcp 2i2c No Yes Core infrastructure has been modified
aws jupyter-meets-the-earth No Yes Core infrastructure has been modified
aws earthscope No Yes Core infrastructure has been modified
aws nasa-esdis No Yes Core infrastructure has been modified
aws nasa-cryo No Yes Core infrastructure has been modified

Production deployments

Cloud Provider Cluster Name Hub Name Reason for Redeploy
aws opensci sciencecore Core infrastructure has been modified
aws nasa-ghg prod Core infrastructure has been modified
kubeconfig utoronto prod Core infrastructure has been modified
kubeconfig utoronto r-prod Core infrastructure has been modified
gcp qcl prod Core infrastructure has been modified
gcp meom-ige prod Core infrastructure has been modified
aws 2i2c-aws-us showcase Core infrastructure has been modified
aws 2i2c-aws-us ncar-cisl Core infrastructure has been modified
aws 2i2c-aws-us go-bgc Core infrastructure has been modified
aws 2i2c-aws-us itcoocean Core infrastructure has been modified
aws 2i2c-aws-us cosmicds Core infrastructure has been modified
aws catalystproject-africa nm-aist Core infrastructure has been modified
aws catalystproject-africa must Core infrastructure has been modified
aws catalystproject-africa uvri Core infrastructure has been modified
aws catalystproject-africa wits Core infrastructure has been modified
aws catalystproject-africa kush Core infrastructure has been modified
aws catalystproject-africa molerhealth Core infrastructure has been modified
aws ubc-eoas prod Core infrastructure has been modified
gcp catalystproject-latam unitefa-conicet Core infrastructure has been modified
gcp catalystproject-latam cicada Core infrastructure has been modified
gcp catalystproject-latam gita Core infrastructure has been modified
gcp hhmi prod Core infrastructure has been modified
gcp hhmi spyglass Core infrastructure has been modified
aws smithsonian prod Core infrastructure has been modified
gcp pangeo-hubs prod Core infrastructure has been modified
gcp pangeo-hubs coessing Core infrastructure has been modified
aws nasa-veda prod Core infrastructure has been modified
gcp linked-earth prod Core infrastructure has been modified
gcp awi-ciroh prod Core infrastructure has been modified
gcp cloudbank bcc Core infrastructure has been modified
gcp cloudbank ccsf Core infrastructure has been modified
gcp cloudbank csm Core infrastructure has been modified
gcp cloudbank dvc Core infrastructure has been modified
gcp cloudbank elcamino Core infrastructure has been modified
gcp cloudbank evc Core infrastructure has been modified
gcp cloudbank glendale Core infrastructure has been modified
gcp cloudbank howard Core infrastructure has been modified
gcp cloudbank miracosta Core infrastructure has been modified
gcp cloudbank skyline Core infrastructure has been modified
gcp cloudbank demo Core infrastructure has been modified
gcp cloudbank fresno Core infrastructure has been modified
gcp cloudbank humboldt Core infrastructure has been modified
gcp cloudbank laney Core infrastructure has been modified
gcp cloudbank sbcc Core infrastructure has been modified
gcp cloudbank sbcc-dev Core infrastructure has been modified
gcp cloudbank elac Core infrastructure has been modified
gcp cloudbank lacc Core infrastructure has been modified
gcp cloudbank lamission Core infrastructure has been modified
gcp cloudbank mills Core infrastructure has been modified
gcp cloudbank mission Core infrastructure has been modified
gcp cloudbank norco Core infrastructure has been modified
gcp cloudbank palomar Core infrastructure has been modified
gcp cloudbank pasadena Core infrastructure has been modified
gcp cloudbank sjcc Core infrastructure has been modified
gcp cloudbank sacramento Core infrastructure has been modified
gcp cloudbank srjc Core infrastructure has been modified
gcp cloudbank saddleback Core infrastructure has been modified
gcp cloudbank santiago Core infrastructure has been modified
gcp cloudbank sjsu Core infrastructure has been modified
gcp cloudbank sierra Core infrastructure has been modified
gcp cloudbank tuskegee Core infrastructure has been modified
gcp cloudbank wlac Core infrastructure has been modified
gcp cloudbank csulb Core infrastructure has been modified
gcp cloudbank csum Core infrastructure has been modified
gcp 2i2c-uk lis Core infrastructure has been modified
aws gridsst prod Core infrastructure has been modified
gcp leap prod Core infrastructure has been modified
aws victor prod Core infrastructure has been modified
aws openscapes prod Core infrastructure has been modified
gcp 2i2c imagebuilding-demo Core infrastructure has been modified
gcp 2i2c demo Core infrastructure has been modified
gcp 2i2c ohw Core infrastructure has been modified
gcp 2i2c aup Core infrastructure has been modified
gcp 2i2c temple Core infrastructure has been modified
gcp 2i2c ucmerced Core infrastructure has been modified
gcp 2i2c climatematch Core infrastructure has been modified
gcp 2i2c mtu Core infrastructure has been modified
gcp 2i2c tufts Core infrastructure has been modified
aws jupyter-meets-the-earth prod Core infrastructure has been modified
aws earthscope prod Core infrastructure has been modified
aws nasa-esdis prod Core infrastructure has been modified
aws jupyter-health prod Core infrastructure has been modified
aws nasa-cryo prod Core infrastructure has been modified

@GeorgianaElena GeorgianaElena changed the title [WIP] Add new cluster DANDI Add new cluster DANDI Mar 28, 2024
@GeorgianaElena
Copy link
Member Author

With the grafana setup, phase 1 and 2 should now be ready. Merging PR

@GeorgianaElena
Copy link
Member Author

thank you @consideRatio and @yuvipanda for the feedback

@GeorgianaElena GeorgianaElena merged commit 4e6f500 into 2i2c-org:main Mar 28, 2024
9 checks passed
Copy link

🎉🎉🎉🎉

Monitor the deployment of the hubs here 👉 https://github.com/2i2c-org/infrastructure/actions/runs/8466675669

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants