WebLLM

webllm.mlc.aisite

Browser language-model inference engine accelerated with WebGPU.

from

WebGPU

added

2026-10-10

likes

0

similar

1. ▲
   vLLM docs.vllm.ai

   site category #artificial-intelligence link ↗

   An inference and serving engine for language models.

2. ▲
   AnimatedLLM animatedllm.github.io

   site category #generative-ai link ↗

   Interactive visualizations explaining how large language models work. #opensource

   
3. ▲
   WebAssembly and WebGPU developer.chrome.com

   site category #webgpu link ↗

   Browser machine-learning performance enhancements, by Google.

   
4. ▲
   Whisper-Web github.com

   tool category #whisper link ↗

   Local transcription using WebGPU, with optimised fine-tuned models for several languages. (FOSS)

   
5. ▲
   Web Stable Diffusion websd.mlc.ai

   site category #webgpu link ↗

   Early browser image-generation demo using WebGPU, with source code.

6. ▲
   vLLM docs.vllm.ai

   site category #urban-and-regional-planning-resources link ↗

   A high-throughput and memory-efficient inference and serving engine for LLMs.

WebGPU › AI libraries: “Browser language-model inference engine accelerated with WebGPU.”