Promptfoo

CI-gated eval + red-teaming (OpenAI).

Update, Nov 12, 2026:Acquired by OpenAI (announced Mar 9, 2026); the project stays open source under MIT.

Rank
#25 of 66#3 of 15 in Evals
Adoption score
78 / 1006.9 points above the category average
Entry price
FreeConfirmed Nov 12, 2026
Open source
YesCan be self-hosted

Our assessment

Promptfoo ranks #3 of 15 in Evals and #25 of 66 overall, with an adoption score of 78, 6.9 points above its category average. Built by OpenAI, it delivers CI-gated eval + red-teaming (OpenAI).

It is open source under the MIT license, so you can self-host it, read the code and avoid vendor lock-in. Entry pricing is Free, confirmed on the official page.

Where it fits: CI/CD automated regression testing and red-teaming for prompts.

Prices and facts come from Promptfoo's own pages; the full list is on the sources page. Suggest an edit.

Best for
CI/CD automated regression testing and red-teaming for prompts
Watch out for
You run and maintain it yourself unless a managed tier is offered.
Consider instead
LangSmith ($39/seat) · Langfuse (Free)

How it compares in Evals

History

Tracked since Oct 13, 2026.

SnapshotRankAdoptionEntry pricePrice check
Nov 20, 2026#25 same78FreeConfirmed
Nov 12, 2026#25 same78FreeConfirmed
Oct 29, 2026#25 same78FreeConfirmed
Oct 15, 2026#25 same78FreeConfirmed
Oct 13, 2026#25 78FreeConfirmed

Key facts

CategoryEvals
MakerOpenAI
LicenseMIT
Open sourceYes
Self-hostYes
Entry priceFree
Category rank#3 of 15
Price checkConfirmed on the vendor's own page

Compare Promptfoo

Get an email when the index changes

Price changes, new tools, acquisitions and shutdowns, sent when the data is updated.