Skip to content
This repository has been archived by the owner on May 22, 2024. It is now read-only.

Implementing a fast scaling and low cost Stable Diffusion inference solution with serverless and containers on AWS

License

Notifications You must be signed in to change notification settings

aws-samples/stable-diffusion-on-eks

NOTE: This repository will be migrated to aws-solutions-library-samples/guidance-for-asynchronous-inference-with-stable-diffusion-on-aws after May 22, and this repo will be archived at that time. Please bookmark new repository for further upgrade.

Stable Diffusion on EKS

Implementing a fast scaling and low cost Stable Diffusion inference solution with serverless and containers on AWS

Stable Diffusion is a popular open source project for generating images using Gen AI. Building a scalable and cost efficient inference solution is a common challenge AWS customers facing. This project shows how to use serverless and container services to build an end-to-end low cost and fast scaling asyncronous image generation architecture. This repo contains the sample code and CDK deployment scripts, helping you to deploy this solution in a few steps.

Features

  • Asyncronous API and Serverless Event-Driven Architecture
  • Image Generation with Stable Diffusion Web UI on Amazon EKS
  • Automatic queue length based scaling with KEDA
  • Automatic provisioning ec2 instances with Karpenter
  • Scaling up new inference nodes within 2 minutes
  • Saving up to 70% with GPU spot instances

Documentations

Check out our live docs! (English | 简体中文)

Security

See CONTRIBUTING for more information.

License

This library is licensed under MIT-0 License. See the LICENSE file.