Promptfoo vs DeepEval

Promptfoo is a CI-gated eval + red-teaming (OpenAI); DeepEval is a pytest-style LLM unit tests. Here is how their price, license and adoption compare.

FeaturePromptfooDeepEval
CategoryEvalsEvals
MakerOpenAIConfident AI
Adoption score78higher69
Category rank#3 of 15#10 of 15
Entry priceFreeFree
LicenseMITApache-2.0
Open sourceYesYes
Self-hostableYesYes
Best forCI/CD automated regression testing and red-teaming for promptsUnit testing LLM outputs inside standard Pytest suites
Price checkConfirmedConfirmed
Websitepromptfoo.devgithub.com/confident-ai/deepeval

Which one to pick

Choose Promptfoo if

you need CI/CD automated regression testing and red-teaming for prompts. It is open source under the MIT license, so you can run it yourself.

Choose DeepEval if

you need unit testing LLM outputs inside standard Pytest suites. It is open source under the Apache-2.0 license, so you can run it yourself.

Get an email when the index changes

Price changes, new tools, acquisitions and shutdowns, sent when the data is updated.