awesome/repos

#1,581 of 5,656 by stars

promptfoo/promptfoo

Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, DeepSeek, and more. Simple declarative configs with command line and CI/CD integration. Used by OpenAI and Anthropic.

Open on GitHubWebsiteOpen comparison
Stars
26,135
Forks
2,515
Created
3y ago
Last push
today

Momentum

Per day
+33
Per 7 days
+207
Per 30 days
+890
Rank, 7 days
+12

Stars over time

25K25.3K25.5K25.8K26K26.3KSep 17Oct 5Oct 12Oct 19
View as table
DateStars
Sep 17, 202625,186
Oct 5, 202625,717
Oct 12, 202625,928
Oct 19, 202626,135

Understand this repo

Open it in a tool that explains, diagrams or digests the code.

Similar repositories

Ranked by how many distinctive topics they share with this one.

  1. 3093

    Supercharge Your LLM Application Evaluations 🚀

    16.1K+70 7d1.9KPython7mo ago
  2. 2467
    19K+187 7d2.1KPythontoday
  3. 1949

    Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards.

    22.7K+207 7d1.9KPythontoday
  4. 909

    🪢 Open source agent evals & observability: Trace, evaluate, and improve LLM applications with one open platform.

    36K+325 7d4KTypeScripttoday
  5. 4583
    11.9K+101 7d1.2KPythontoday
  6. 808

    An AI prompt optimizer for writing better prompts and getting better AI results.

    38.5K+829 7d4.4KTypeScripttoday