Hugging Face Announces WebGPU Kernels for Local AI
Hugging Face introduces 200+ WebGPU kernels to accelerate local AI inference in web browsers, aiming to improve speed and user-friendliness.
Hugging Face introduces 200+ WebGPU kernels to accelerate local AI inference in web browsers, aiming to improve speed and user-friendliness.
TL;DR Why start with kernels? A kernel repository, not just a shader Loading a kernel from the Hub How fast are the kernels? From one device to a fleet Building a shared foundation for WebAI One of our biggest goals on the WebAI team at Hugging Face is to make browser inference…
Today, we are releasing the first layer of that effort: @huggingface/kernels , a minimal library for loading and running optimized WebGPU kernels from the Hugging Face Hub, together with an initial collection of 207 kernels at huggingface.co/webgpu-kernels .