On-Device AI in the Browser: WebGPU, Web Workers and Chrome's Built-in AI
When running a model on the user's machine makes sense and when it doesn't, how far Chrome's built-in AI has shipped, Transformers.js, ONNX Runtime Web and WebLLM on WebGPU/WASM, running inference in a Web Worker, caching model weights, and UX for the first download.
Frontend & UI9 min