Skip to content
TechIndexSubmit
Back to directory

open-model-router

Route prompts across open-weight LLMs (Llama, Qwen, Mistral, DeepSeek): OpenAI-compatible gateway with cascades, fallbacks, agentic RAG and evals.

Similar tools

  • Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.

    Models
  • Universal LLM Gateway: One API, every LLM. OpenAI/Anthropic-compatible endpoints with multi-provider translation and intelligent load-balancing.

    Models
  • Self-hosted FastAPI gateway exposing OpenAI and Anthropic Messages APIs in front of any open-source LLM runtime (vLLM, Ollama, llama.cpp, TGI, SGLang, LocalAI, LM Studio). Streaming, embeddings, metrics, auth, rate limiting.

    Models
  • Lightweight unified multi-LLM API gateway, support OpenAI / Gemini, local deployment quick start template

    Models
  • Route OpenAI calls to 20+ free AI providers with fallback, 429 handling, and zero dependencies

    Dev Tools
  • Unified AI Gateway for 30+ LLMs (OpenAI, Anthropic, Bedrock, Azure etc) with Caching, Guardrails, A/B test & cost controls. Go-native Fastest & Scalable AI Gateway LiteLLM & Kong AI Gateway alternative.

    Dev Tools