LLM/agent observability inside Datadog's APM suite, billing only on LLM spans with built-in online/offline evals.
Pricing: Free: up to 40k LLM spans/mo, 15-day retention; Pro from $160/mo for 100k LLM spans + on-demand overage; only LLM spans are billed (tool/agent/retrieval spans free).
Instant self-serve — free signup gives a key immediately (a human unblocks an agent in under 2 minutes).
Requires a Datadog account (free trial, no CC); API key + application key are self-serve in Organization Settings. Enterprise/account-based, no autonomous account-provisioning API.
Datadog LLM Observability — LLM/agent observability inside Datadog's APM suite, billing only on LLM spans with built-in online/offline evals.
Website: https://www.datadoghq.com/product/ai/llm-observability/
Docs: https://docs.datadoghq.com/llm_observability/
Get a key: https://www.datadoghq.com/free-datadog-trial/
Agent signup: self serve instant key — Requires a Datadog account (free trial, no CC); API key + application key are self-serve in Organization Settings. Enterprise/account-based, no autonomous account-provisioning API.
Auth: api-key
Pricing: freemium — Free: up to 40k LLM spans/mo, 15-day retention; Pro from $160/mo for 100k LLM spans + on-demand overage; only LLM spans are billed (tool/agent/retrieval spans free).
Full record: https://dreaming.press/api/tools/datadog-llm-observability.jsonMachine record: /api/tools/datadog-llm-observability.json
# pip install ddtrace
from ddtrace.llmobs import LLMObs
LLMObs.enable(
ml_app="my-app",
api_key="<DD_API_KEY>",
site="datadoghq.com",
agentless_enabled=True,
)
# LLM calls within traced functions now appear in LLM Observabilitypython · full docs →
Datadog LLM Observability is LLM/agent observability inside Datadog's APM suite, billing only on LLM spans with built-in online/offline evals. It's in the Observability & evals (managed) category of the dreaming.press tool directory.
Datadog LLM Observability is freemium — free to start, paid plans for scale. Free: up to 40k LLM spans/mo, 15-day retention; Pro from $160/mo for 100k LLM spans + on-demand overage; only LLM spans are billed (tool/agent/retrieval spans free)..
Almost — signup is instant and self-serve (a free key with no sales call), so a human can unblock an agent in under two minutes. Requires a Datadog account (free trial, no CC); API key + application key are self-serve in Organization Settings. Enterprise/account-based, no autonomous account-provisioning API..
Datadog LLM Observability does not publish an official MCP server as of our last check.
Datadog LLM Observability is a hosted API service, not an open-source project.
Datadog LLM Observability offers Python, TypeScript, OpenTelemetry, REST.
We track the AI stack so you don't have to — pricing, MCP support, and which tools an agent can sign up for. Free.