vLLM

docs.vllm.aisite

An inference and serving engine for language models.

similar

vLLM docs.vllm.ai
site category #urban-and-regional-planning-resources link ↗

A high-throughput and memory-efficient inference and serving engine for LLMs.
AnimatedLLM animatedllm.github.io
site category #generative-ai link ↗

Interactive visualizations explaining how large language models work. #opensource
Llama llama.com
site category #generative-ai link ↗

Meta's open source large language model. #opensource
LLM llm.datasette.io
site category #generative-ai link ↗

A CLI utility and Python library for interacting with Large Language Models, remote and local. #opensource
WebLLM webllm.mlc.ai
site category #webgpu link ↗

Browser language-model inference engine accelerated with WebGPU.
LMQL lmql.ai
site category #generative-ai link ↗

LMQL is a query language for large language models.

Artificial Intelligence › Build AI systems > Deployment and observability: “An inference and serving engine for language models.”