Skip to content
TechIndexSubmit
Back to directory

promptfoo

Models26.0k

Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, DeepSeek, and more. Simple declarative configs with command line and CI/CD integration. Used by OpenAI and Anthropic.

Similar tools

  • A CLI that turns a goal into a pull request - and a sandbox for testing concurrent AI coding agents on the Mozaik runtime.

    Dev Tools
  • Evaluate your LLM's response with Prometheus and GPT4 💯

    Dev Tools
  • A tool for threat modeling AI coding agents by pointing them at a repository to generate an evidence-traced threat model. It supports various architectures and methods for AI security.

    Dev Tools
  • Test and evaluate LLMs and model configurations, across all the scenarios that matter for your application

    Dev Tools
  • 🔥 The Ultimate Master AI Prompts Collection — High-performance, production-ready prompts for Developers, Software Architects, Copywriters, and AI Agents (ChatGPT, Claude, Gemini, DeepSeek, Cursor, Windsurf).

    Prompts
  • Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards.

    Models