Skip to content
TechIndexSubmit
Back to directory

open-llm-benchmarks

Open-source LLM inference benchmarks — TTFT, TPOT, Throughput, Latency & Cost-per-token for models like Llama, Qwen, Gemma, DeepSeek, Gpt-Oss etc. deployed on different dedicated GPUs.

Similar tools

  • Open Source LLM — llama 4, deepseek v3, qwen 2.5, open source ai.

    Models
  • Empirical LLM evaluation on CPU-only testlab hardware — 5 models benchmarked for agent-capability: speed, tool-call validity, and reasoning quality

    Models
  • OpenCompass is an LLM evaluation platform, supporting a wide range of models from OpenAI, Anthropic, Gemini, Qwen, GLM, DeepSeek, etc, across 100+ datasets covering knowledge, reasoning, coding, science, language, long-context, and safety.

    Models
  • Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.

    Models
  • Get up and running with Kimi, GLM, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.

    Models
  • Local LLM cost-tracking proxy for OpenAI, Anthropic, Gemini, and pinned OpenRouter calls with token usage, failure, and billing-integrity receipts.

    Dev Tools