Hugging Face Storage 与 SkyPilot 集成,以实现零出站的 AI 工作负载
Hugging Face 和 SkyPilot 已集成,以实现 AI 工作负载的零出站存储,使团队能够在任何云平台上运行工作负载,并在 Hugging Face 上存储数据,而无需跨云传输成本。
Hugging Face 和 SkyPilot 已集成,以实现 AI 工作负载的零出站存储,使团队能够在任何云平台上运行工作负载,并在 Hugging Face 上存储数据,而无需跨云传输成本。
Hugging Face Buckets are built on Xet , which uses content-defined chunking to split files into ~64 KB chunks and store each unique chunk once.
Hugging Face Storage is now a first-class SkyPilot backend No egress: storage stops deciding where you run A quick benchmark Xet-backed storage: dedup for checkpoints and model variants Get started Built together: Hugging Face and SkyPilot Resources For most teams, models and da…
Together with Hugging Face, we've joined the two halves: your models and datasets stay on the Hub, and SkyPilot runs the compute (dev, training, or serving) on whatever cluster has the GPUs. Mount a Hugging Face Bucket or any Hub repo into a SkyPilot job with one hf:// URL and t…