⚔ Promptfoo appears in the Perception Lab: forced-choice runs vs Braintrust →
When buyers ask ChatGPT, Claude, and Gemini about llm & agent evals, Promptfoo ranks #7 of 15, a Visibility Score of 28 in LLM & Agent Evals .
These rankings are measured from what the three models know from training, not a live web search. The live-web grounded surface is rolling out across the index. Methodology.
Mid-pack in one race, with no other races entered.
Where it wins. Promptfoo earns a 36% mention rate in LLM & Agent Evals, and startup teams specifically pull it into consideration more than any other buyer segment.
Where it loses. At rank 7 of 15 with only an 11% first-pick rate, it loses the final decision to stronger signals from LangSmith and DeepEval, and Feature-led buying queries skip it entirely.
AI-generated analysis of the September 2026 measurements.
One of the index's bigger model splits: see where the models disagree →
Being named is not the same as being recommended. Each mention is graded endorsed (a strong pick), listed (a neutral option), or caveated (named with a reservation).
Share of each theme's answers that mention Promptfoo. Hover a row for the exact prompt. Compare shapes on the head-to-head page.
Gaps Feature-led ask
Share of Promptfoo's mentions where the AI models name this brand in the same answer. That is the real competitive set in the AI channel.
Scores are measured from real AI answers, refreshed monthly. Methodology.
We rerun the index every month. Drop your email and pick what to watch in LLM & Agent Evals: the whole category or specific brands. Free, unsubscribe anytime.