Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support spot pricing on AWS #82

Open
milliams opened this issue Jul 20, 2020 · 0 comments
Open

Support spot pricing on AWS #82

milliams opened this issue Jul 20, 2020 · 0 comments
Labels
enhancement New feature or request

Comments

@milliams
Copy link
Member

To make things cheaper, we should support interruptible instance type. This model is available on AWS as spot instances and Google as preemptible instance.

On AWS, an instance started as a spot instance will have a metadata service endpoint at http://169.254.169.254/latest/meta-data/spot/termination-time if it is marked to be interrupted. This should be polled for every 5 seconds.

This can then either be passed through the monitoring system so that the management node can respond or perhaps the compute node itself can trigger the POWER_DOWN state in directly Slurm with an scontrol call.

On the other side, we need a mechanism for specifying that the user wants spot pricing. Either this could be done on a cluster--wide level, a instance type-level or perhaps a job-level.

@milliams milliams added the enhancement New feature or request label Jul 20, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant