DeepEval

Pytest-style LLM unit tests.

Rank
#42 of 66#10 of 15 in Evals
Adoption score
69 / 1002.1 points below the category average
Entry price
FreeConfirmed Nov 12, 2026
Open source
YesCan be self-hosted

Our assessment

DeepEval ranks #10 of 15 in Evals and #42 of 66 overall, with an adoption score of 69, 2.1 points below its category average. Built by Confident AI, it delivers pytest-style LLM unit tests.

It is open source under the Apache-2.0 license, so you can self-host it, read the code and avoid vendor lock-in. Entry pricing is Free, confirmed on the official page.

Where it fits: Unit testing LLM outputs inside standard Pytest suites.

Prices and facts come from DeepEval's own pages; the full list is on the sources page. Suggest an edit.

Best for
Unit testing LLM outputs inside standard Pytest suites
Watch out for
You run and maintain it yourself unless a managed tier is offered.
Consider instead
LangSmith ($39/seat) · Langfuse (Free)

How it compares in Evals

History

Tracked since Oct 13, 2026.

SnapshotRankAdoptionEntry pricePrice check
Nov 20, 2026#42 same69FreeConfirmed
Nov 12, 2026#42 same69FreeConfirmed
Oct 29, 2026#42 same69FreeConfirmed
Oct 15, 2026#42 same69FreeConfirmed
Oct 13, 2026#42 69FreeConfirmed

Key facts

CategoryEvals
MakerConfident AI
LicenseApache-2.0
Open sourceYes
Self-hostYes
Entry priceFree
Category rank#10 of 15
Price checkConfirmed on the vendor's own page

Compare DeepEval

Get an email when the index changes

Price changes, new tools, acquisitions and shutdowns, sent when the data is updated.