Best LLM evaluation and observability tools

15 tools for tracing, evaluating, monitoring and red-teaming LLM apps, ranked by adoption. The most used is LangSmith ($39/seat), and 12 of the 15 are free or open source. Updated Nov 20, 2026.

RankToolCategory Adoptionvs. categoryFrom LicensePrice check
1 LangSmithTracing + eval workflows Evals 86 +14.9 $39/seat Proprietary Confirmed
2 LangfuseOpen-source tracing + evals Evals 83 +11.9 Free MIT Confirmed
3 PromptfooCI-gated eval + red-teaming (OpenAI) Evals 78 +6.9 Free MIT Confirmed
4 BraintrustThe production quality loop, flat rate Evals 76 +4.9 $249/mo Proprietary Confirmed
5 W&B WeaveTracing + evals from Weights & Biases Evals 75 +3.9 Free Apache-2.0 Confirmed
6 RagasThe core RAG metrics library Evals 74 +2.9 Free Apache-2.0 Confirmed
7 HeliconeOne-line LLM observability proxy Evals 73 +1.9 Free Apache-2.0 Confirmed
9 Arize PhoenixOpen-source tracing + eval Evals 71 −0.1 Free Elastic-2.0 Confirmed
10 DeepEvalPytest-style LLM unit tests Evals 69 −2.1 Free Apache-2.0 Confirmed
11 TruLensRAG triad evaluation & neural metrics Evals 68 −3.1 Free MIT Confirmed
12 GiskardOpen-source QA & vulnerability scanning for LLMs Evals 64 −7.1 Free Apache-2.0 Confirmed
13 GalileoEnterprise eval + guardrails Evals 61 −10.1 $100/mo Proprietary Confirmed
14 UpTrainLLM evaluation & root-cause regression testing Evals 60 −11.1 Free Apache-2.0 Confirmed
15 Comet OpikOpen-source eval + tracing by Comet Evals 56 −15.1 Free Apache-2.0 Confirmed

Head-to-head

Other categories

Get an email when the index changes

Price changes, new tools, acquisitions and shutdowns, sent when the data is updated.