EricLBuehler/mistral.rs

github.comtool

[mistralrs] - Fast, flexible LLM inference engine supporting multimodal models, quantization (GGUF/GPTQ/ISQ), and OpenAI-compatible API

from

Rust

added

2026-10-10

likes

0

Rust › Libraries > Artificial Intelligence > Machine learning: “[mistralrs] - Fast, flexible LLM inference engine supporting multimodal models, quantization (GGUF/GPTQ/ISQ), and OpenAI-compatible API”