Hugging Face and SkyPilot have integrated to enable zero-egress storage for AI workloads, allowing teams to run workloads on any cloud and store data on Hugging Face without cross-cloud transfer costs.
Hugging Face Buckets are built on Xet , which uses content-defined chunking to split files into ~64 KB chunks and store each unique chunk once.
Hugging Face Storage is now a first-class SkyPilot backend No egress: storage stops deciding where you run A quick benchmark Xet-backed storage: dedup for checkpoints and model variants Get started Built together: Hugging Face and SkyPilot Resources For most teams, models and da…
Together with Hugging Face, we've joined the two halves: your models and datasets stay on the Hub, and SkyPilot runs the compute (dev, training, or serving) on whatever cluster has the GPUs. Mount a Hugging Face Bucket or any Hub repo into a SkyPilot job with one hf:// URL and t…
