dogear

enter for all results · esc to close

vLLM

docs.vllm.aisite

A high-throughput and memory-efficient inference and serving engine for LLMs.

visit docs.vllm.ai ↗
0
sign in to dogear this
from
Urban & Regional Planning
added
2026-10-10
likes
0

similar

  1. vLLM docs.vllm.ai
    site category #artificial-intelligence link ↗

    An inference and serving engine for language models.

  2. RunThisLLM runthisllm.com
    site category #generative-ai link ↗

    See which LLMs you can run on your hardware.

  3. LLM llm.datasette.io
    site category #generative-ai link ↗

    A CLI utility and Python library for interacting with Large Language Models, remote and local. #opensource

  4. ReqLLM github.com
    tool category #elixir link ↗

    LLM Client supporting over 100+ LLM Providers and Models

  5. WebLLM webllm.mlc.ai
    site category #webgpu link ↗

    Browser language-model inference engine accelerated with WebGPU.

  6. AnimatedLLM animatedllm.github.io
    site category #generative-ai link ↗

    Interactive visualizations explaining how large language models work. #opensource

Urban & Regional Planning › Platforms and Software Resources > AI in Planning Tools and Platforms: “A high-throughput and memory-efficient inference and serving engine for LLMs.”