| Feature | Promptfoo | DeepEval |
|---|---|---|
| Category | Evals | Evals |
| Maker | OpenAI | Confident AI |
| Adoption score | 78higher | 69 |
| Category rank | #3 of 15 | #10 of 15 |
| Entry price | Free | Free |
| License | MIT | Apache-2.0 |
| Open source | Yes | Yes |
| Self-hostable | Yes | Yes |
| Best for | CI/CD automated regression testing and red-teaming for prompts | Unit testing LLM outputs inside standard Pytest suites |
| Price check | Confirmed | Confirmed |
| Website | promptfoo.dev | github.com/confident-ai/deepeval |
Which one to pick
Choose Promptfoo if
you need CI/CD automated regression testing and red-teaming for prompts. It is open source under the MIT license, so you can run it yourself.
Choose DeepEval if
you need unit testing LLM outputs inside standard Pytest suites. It is open source under the Apache-2.0 license, so you can run it yourself.

