Observability tools for agents

Tools that record what an agent did: traces of model and tool calls, costs, latency and errors, often collected over OpenTelemetry. For each one we write whether OpenTelemetry support is stated in a source we read, which interfaces it exposes, its license and its last commit date. Hosted and self-hosted options are written only when the tool's own pages describe them, with the reading date. On this page, tools are sorted by the date of their last check, newest first. There are no votes and no rank, and a dashed pin means we have not looked yet.Read more
  • Supported, verified
  • Not supported
  • Not checked yet
Must have:

Showing 10 of 10 tools.

Observability tools and their verified pins, sorted by last check
ToolMCPAPICLIPyTSOASLicenseLast commitChecked
MLflow Tracingnot checked yetnot checked yetsupported, verifiedsupported, verifiedsupported, verifiednot checked yetApache-2.0
Pydantic Logfirenot checked yetnot checked yetsupported, verifiedsupported, verifiedsupported, verifiednot checked yetMIT
Weavenot checked yetnot checked yetnot checked yetsupported, verifiednot checked yetnot checked yetApache-2.0
Opiksupported, verifiednot checked yetnot checked yetsupported, verifiednot checked yetnot checked yetApache-2.0
Arize Phoenixsupported, verifiednot checked yetsupported, verifiednot checked yetsupported, verifiednot checked yetElastic-2.0
Langfusesupported, verifiedsupported, verifiednot checked yetnot checked yetsupported, verifiedsupported, verifiedMIT (Expat) outside the ee directories, which have their own license
OpenLITnot checked yetnot checked yetsupported, verifiednot checked yetsupported, verifiednot checked yetApache-2.0
AgentOpsnot checked yetnot checked yetnot checked yetsupported, verifiednot checked yetnot checked yetMIT
Laminarsupported, verifiednot checked yetsupported, verifiednot checked yetsupported, verifiednot checked yetApache-2.0
OpenLLMetrynot checked yetnot checked yetnot checked yetnot checked yetsupported, verifiednot checked yetApache-2.0

How to choose

  1. Interface. MCP if your agent already speaks it. HTTP API if you call from a queue or a worker. A Python or TypeScript SDK if the tool runs inside your own code.
  2. License. Self-hosting needs a license that allows it. Source-available is not open source.
  3. Activity. Check the last commit date. A tool with no commit for months may still work, but nobody is fixing it.

Nearby