Michael-A-Kuykendall/shimmy

github.comtool

[shimmy] - Pure-Rust WebGPU inference engine with an OpenAI-compatible API and native GGUF support.

from

Machine Learning, Rust

added

2026-10-10

likes

0

Machine Learning › Rust > Natural Language Processing: “Python-free Rust inference server for NLP models with OpenAI API compatibility and hot model swapping.”

Rust › Libraries > Artificial Intelligence > Machine learning: “[shimmy] - Pure-Rust WebGPU inference engine with an OpenAI-compatible API and native GGUF support.”