-
Notifications
You must be signed in to change notification settings - Fork 485
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[k8s] Add support for autoscaling kubernetes clusters #3513
Conversation
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thanks for quickly adding this support @romilbhardwaj! Looks mostly good to me.
sky/cli.py
Outdated
if cloud_is_kubernetes and kubernetes_autoscaling: | ||
yield kubernetes_utils.KUBERNETES_AUTOSCALER_NOTE |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Does this mean when the cloud
is not specified, i.e. None, we will not print the hint? Should we print the hint if cloud is None
as well.
Also, in the show_all case, should we print this hint as well?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
ahh good point - fixed now! shown when cloud is not specified and also in show_all case.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM! Thanks @romilbhardwaj !
Thanks @Michaelvll! Tested on karpenter and GKE nodepool autoscaling, merging now. |
Adds
autoscaler
field to config.yaml to allow the user to specify the autoscaler used in the underlying kubernetes cluster:Setting this field:
When used in conjunction with
provision_timeout
, this allows users to bring in their scale-to-zero k8s clusters and use them with SkyPilot.Currently supported autoscalers: GKE nodepools, Karpenter, any generic CA that can label new nodes with
skypilot.co/accelerator
(Related - #3432)More context: https://docs.google.com/document/d/17LRYGCKDsY9AygAJbUIiQR4KkHZqSakL8G0SF7WNOR8/edit?usp=sharing
Tested (run the relevant ones):
bash format.sh