Release 0.5.0

[Michaelvll]

• pytest tests/test_smoke.py (commit: 92b2e11)
• pytest tests/test_smoke.py --aws (except for test_aws_custom_image being fixed in [Storage] Storage mounting tool permissions fix #3215)
• pytest tests/test_smoke.py --gcp
• pytest tests/test_smoke.py --azure (except for test_job_queue_with_docker being fixed in [Docker] Add retry for docker pull due to daemon not ready #3218)
• pytest tests/test_smoke.py --kubernetes
• locally build docs, open docs/build/index.html, scroll over “CLI Reference” (ideally, every page) to see if there are missing sections (we once caught the CLI page completely missing due to an import error; and once it has weird blockquotes displayed)
• Check sky -v
• backward_compatibility_tests.sh run against 0.4.1 on aws
• backward_compatibility_tests.sh run against 0.4.1 on gcp
• Run manual stress tests (see subsection below)
  • following script

    sky spot launch --gpus A100:8 --cloud aws echo hi -y
    # Check we are properly failing over the zones:
    sky spot logs --controller
    

  • following script (skipped, not enough quotas)

    sky launch -c dbg --cloud aws --num-nodes 16 --gpus T4 --down --use-spot 
    sky down dbg
    

  • sky launch --num-nodes=75 -c dbg --cpus 2+ --use-spot --down --cloud gcp -y
  • sky launch --num-nodes=75 -c dbg --cpus 2+ --use-spot --down --cloud aws -y

[concretevitamin]

Is test_aws_custom_image related to #3213?

[Michaelvll]

Is test_aws_custom_image related to #3213?

it seems to be related to #3215. Will get that merged soon : )

[romilbhardwaj]

Thanks @Michaelvll 🎉

[concretevitamin]

LGTM!