logo

Getting Started

  • Installation
  • Quickstart
  • Tutorial: DNN Training
  • GPU-backed Jupyter Notebooks

Running Jobs

  • Managed Spot Jobs
  • Job Queue
  • Auto-provisioning GPUs
  • Running on Kubernetes
    • Kubernetes Cluster Setup
  • More User Guides
    • Distributed Jobs on Many VMs
    • Using Environment Variables

Cutting Cloud Costs

  • Managed Spot Jobs
  • Autostop and Autodown
  • Benchmark: Find the Best Hardware for Your Jobs
    • CLI
    • YAML Configuration
    • SkyCallback

Using Data

  • Syncing Code and Artifacts
  • SkyPilot Storage

User Guides

  • Using Docker Containers
  • Opening Ports
  • Cloud TPU
  • Usage Collection
  • Frequently Asked Questions

Cloud Admin and Usage

  • Minimal Cloud Permissions
    • AWS
    • GCP
  • Cloud Authentication
  • Requesting Quota Increase

References

  • Task YAML
  • Command Line Interface
  • Python API
  • Advanced Configurations
Theme by the Executable Book Project

More User Guides

More User GuidesΒΆ

  • Distributed Jobs on Many VMs
    • Environment variables
    • Launching a multi-node task (new cluster)
    • Launching a multi-node task (existing cluster)
    • Executing a task on the head node only
    • SSH into worker nodes
  • Using Environment Variables
    • User-specified environment variables
      • Using in file_mounts
      • Using in setup and run
      • Passing secrets
    • SkyPilot environment variables

previous

Kubernetes Cluster Setup

next

Distributed Jobs on Many VMs

By the SkyPilot authors
© Copyright 2023, SkyPilot Team.