Skip to content
TechIndexSubmit
Back to directory

local-llm-benchmark

Empirical LLM evaluation on CPU-only testlab hardware — 5 models benchmarked for agent-capability: speed, tool-call validity, and reasoning quality

Similar tools

  • Bilingual (Polish + English) quality evals for local open LLMs as agents and assistants: tool calling, multi-step tasks, frozen-web shopping, instruction following, writing. Every result paired with a replicable run spec.

    Models
  • Open-source LLM inference benchmarks — TTFT, TPOT, Throughput, Latency & Cost-per-token for models like Llama, Qwen, Gemma, DeepSeek, Gpt-Oss etc. deployed on different dedicated GPUs.

    Models
  • Test and evaluate LLMs and model configurations, across all the scenarios that matter for your application

    Dev Tools
  • 🕹️ Performance Comparison of MLOps Engines, Frameworks, and Languages on Mainstream AI Models.

    Dev Tools
  • Multi-agent LLM simulation: five agents review database capacity, reliability and FinOps decisions over evidence that is checked, not trusted. Deterministic queueing and cost models, real MySQL/PostgreSQL labs, AWS/GCP/Azure imports. Runs on Claude, any OpenAI-compatible endpoint, or a free local model through Ollama.

    Models
  • Running Llama 2 and other Open-Source LLMs on CPU Inference Locally for Document Q&A

    Models