Datadog LLM Observability SDKddtrace (APM)Datadog Agent (opt.)Python/JupyterOpenAIintermediate30 min

Datadog LLM Observability + APM integration

End-to-end tracing from application code through LLM agents/tools/RAG, correlating infra perf with AI metrics (latency, tokens, evals).

Prerequisites

  • Datadog account with API key
  • APM enabled
  • LLM provider API key (e.g.
  • OpenAI)
  • Python app with LLM calls (e.g.
  • OpenAI
  • LangChain)
  • ddtrace/LLMObs SDK installed.

Further reading