Observability & Evals

Tracing, token accounting, and evaluation. Standard APM misses the agent loop; these tools instrument the decisions.

5 tools indexed

by Langfuse

Open-source LLM tracing, evaluation, and prompt management.

by LangChain

Tracing, evaluation, and monitoring from the LangChain team.

by Arize AI

Open-source, OpenTelemetry-native tracing and evaluation for LLM apps.

by Braintrust

Evaluation-first platform for shipping LLM changes with measured confidence.

by Helicone

Open-source LLM gateway with logging, caching, and cost tracking.

Other layers