Groq

groq.comsite

A cloud inference API for running open-source LLMs, powered by custom LPU hardware.

from

Generative AI

added

2026-10-10

likes

0

similar

1. ▲
   Grok grok.x.ai

   site category #generative-ai link ↗

   An LLM by xAI with open source and open weights. #opensource

   
2. ▲
   EricLBuehler/mistral.rs github.com

   tool category #rust link ↗

   [mistralrs] - Fast, flexible LLM inference engine supporting multimodal models, quantization (GGUF/GPTQ/ISQ), and OpenAI-compatible API

   
3. ▲
   Open LLMs github.com

   tool category #generative-ai link ↗

   A list of open LLMs available for commercial use.

   
4. ▲
   Rapid-MLX github.com

   tool category #generative-ai link ↗

   OpenAI-compatible local LLM inference server optimized for Apple Silicon, with tool calling, reasoning, vision, and structured output support. #opensource

   
5. ▲
   OpenLIT github.com

   tool category #generative-ai link ↗

   Open-source GenAI and LLM observability platform native to OpenTelemetry with traces and metrics. #opensource

   
6. ▲
   OpenRouter openrouter.ai

   site category #generative-ai link ↗

   A unified interface for LLMs. #opensource

   

Generative AI › Coding > Developer tools: “A cloud inference API for running open-source LLMs, powered by custom LPU hardware.”