Welcome to SkyPilot!
Welcome to SkyPilot!¶
Run LLMs and AI on Any Cloud
SkyPilot is a framework for running LLMs, AI, and batch jobs on any cloud, offering maximum cost savings, highest GPU availability, and managed execution.
SkyPilot abstracts away cloud infra burdens:
Launch jobs & clusters on any cloud
Easy scale-out: queue and run many jobs, automatically managed
Easy access to object stores (S3, GCS, R2)
SkyPilot maximizes GPU availability for your jobs:
Provision in all zones/regions/clouds you have access to (the Sky), with automatic failover
SkyPilot cuts your cloud costs:
Managed Spot: 3-6x cost savings using spot VMs, with auto-recovery from preemptions
Optimizer: 2x cost savings by auto-picking the cheapest VM/zone/region/cloud
Autostop: hands-free cleanup of idle clusters
SkyPilot supports your existing GPU, TPU, and CPU workloads, with no code changes.
Current supported providers (AWS, Azure, GCP, Lambda Cloud, IBM, Samsung, OCI, Cloudflare, any Kubernetes cluster):
Tutorials: SkyPilot Tutorials
LLMs on SkyPilot
Mistral 7B (from official Mistral team)
vLLM: Serving LLM 24x Faster On the Cloud (from official vLLM team)
Vicuna chatbots: Training & Serving (from official Vicuna team)
Add yours here & see more in llm/!
Read the research: