Skip to content
TechIndexSubmit
Back to directory

local-llm-quality-bench

Bilingual (Polish + English) quality evals for local open LLMs as agents and assistants: tool calling, multi-step tasks, frozen-web shopping, instruction following, writing. Every result paired with a replicable run spec.

Similar tools

  • Empirical LLM evaluation on CPU-only testlab hardware — 5 models benchmarked for agent-capability: speed, tool-call validity, and reasoning quality

    Models
  • Prompts, agent configs, and reference data for using open-weight LLMs to generate automated tests (unit, API, UI/E2E, BDD)

    Models
  • Assessing the reliability, accuracy, and safety of large language models, RAG pipelines, and AI agents.

    Models
  • Six open LLMs, three attack axes, fully local — measuring attack-resistance vs over-refusal, and how far to trust a local judge.

    Models
  • Open-source LLM inference benchmarks — TTFT, TPOT, Throughput, Latency & Cost-per-token for models like Llama, Qwen, Gemma, DeepSeek, Gpt-Oss etc. deployed on different dedicated GPUs.

    Models
  • Local LLM cost-tracking proxy for OpenAI, Anthropic, Gemini, and pinned OpenRouter calls with token usage, failure, and billing-integrity receipts.

    Dev Tools