Skip to technology filters Skip to main content
Dynatrace Hub

Extend the platform,
empower your team.

Popular searches:
Home hero bg
OpenTelemetry for GenAIOpenTelemetry for GenAI
OpenTelemetry for GenAI

OpenTelemetry for GenAI

Ingest and analyze OTel GenAI traces & metrics for your AI workloads.

Technology
Free trialDocumentation
OTel based AI Agents topology and dependency map showing multi-agent call relationships with per-agent LLM req counts, token usage, and response time.Prompts stream showing all Agent and LLM interactions with model version, token count, and full prompt/response content.Trace-level debug view showing agentic span hierarchy, tool calls, prompt and response content, and agent topology for a single AI agent run.OTel based LLM-as-judge evaluation detail with score, pass/fail label, explanation, and gen_ai.evaluation.* attributes.Evaluation performance for OTel based gen_ai applications
  • Product information

Overview

OpenTelemetry is the vendor-neutral, CNCF standard for collecting traces, metrics, and logs from any application. The GenAI semantic conventions extend OpenTelemetry with a consistent, provider-agnostic schema for AI-specific signals — model names, token counts, latency, cost, agent runs, tool calls, and evaluation results — across every major LLM provider.

Dynatrace natively understands gen_ai.* attributes with zero transformation required. Send spans and metrics directly to the Dynatrace OTLP endpoint or through a Collector and your data populates the AI Observability app immediately — no third-party instrumentation library, no attribute normalization step.

This is the lowest-overhead path to AI observability: instrument once with the open standard, export over OTLP, and get full model performance, cost, and agentic workflow visibility out of the box.

Use cases

Monitor AI service health and performance

  • Detect bottlenecks by tracking real-time metrics: gen_ai.client.operation.duration and gen_ai.client.token.usage — across models and providers.
  • Manage costs with automated token-level cost calculations broken down by gen_ai.provider.name and gen_ai.request.model.
  • Set error budgets for performance and cost controls

End-to-end tracing and debugging of agentic AI

  • Achieve full visibility of prompt flows, tool calls, retrieval steps, and agent handoffs — from invoke_agent to final response — using standardized span names and the W3C Trace Context propagation built into OTel.
  • Capture detailed debug data including full prompt and completion content via gen_ai.input.messages and gen_ai.output.messages (opt-in, disabled by default to protect sensitive data).
  • Pinpoint exact failure points across chat, execute_tool, retrieval, and invoke_workflow spans with no vendor-specific wrappers.

Multi-provider and multi-model visibility

  • Instrument once and compare performance side by side across OpenAI, Anthropic, Azure OpenAI, AWS Bedrock, Google Gemini, and any custom endpoint: all using the same gen_ai.* schema.
  • Detect provider-level degradation and attribute token usage and latency to specific models for accurate cost allocation.
  • Track model version rollouts and routing decisions in a single trace view.

Evaluate AI quality in production

  • Attach evaluation results with dt-evals — scores, labels, and explanations — to inference spans using gen_ai.evaluation.result events, enabling LLM-as-judge and custom evaluator output alongside latency and cost.
  • Correlate quality regressions with model version changes, prompt updates, or provider switches in the same distributed trace.
  • Build quality dashboards on top of gen_ai.evaluation.score.value and gen_ai.evaluation.name metrics alongside standard operational signals.

Get started

Instrumenting your AI application with native OpenTelemetry requires no additional library beyond the standard OTel SDK. Initialize a TracerProvider, add gen_ai.* attributes to your spans, and point the OTLP exporter at your Dynatrace environment. For metrics, add a MeterProvider and emit gen_ai.client.token.usage and gen_ai.client.operation.duration histograms alongside your traces.

To get started, see our OpenTelemetry GenAI instrumentation examples on GitHub and the OpenTelemetry and AI Observability getting started guide.

Additionally, you can read more about how to install the AI Observability app.

Dynatrace
Documentation
By Dynatrace
Dynatrace support center
Copy to clipboard
Dynatrace Hub
Hub HomeGet data into DynatraceBuild your own app
Dynatrace Intelligence - Agentic Operations SystemThe Dynatrace Agentic AI ecosystem
All (914)Log Management and AnalyticsKubernetesInfrastructure ObservabilitySoftware DeliveryApplication ObservabilityApplication SecurityBusiness ObservabilityDigital Experience
Filter
Type
Built and maintained by
Deployment model
SaaS
  • SaaS
  • Managed
Partner FinderBecome a partnerDynatrace Developer

AI and LLM Observability

Achieve complete visibility and insights across every layer of your AI and LLM ecosystem – from data ingestion and vector stores to agentic frameworks and prompt engineering – ensuring optimal performance, cost efficiency, compliance, and system reliability at scale.

Essentials

AI Observability logo

AI Observability

End-to-end observability for your Agentic AI and LLM workloads.

OneAgent for GenAI logo

OneAgent for GenAI

Monitor and trace your AI workloads and apps automatically with OneAgent.

OpenTelemetry for GenAI logo

OpenTelemetry for GenAI

Ingest and analyze OTel GenAI traces & metrics for your AI workloads.

OpenInference logo

OpenInference

Instrument your AI agents, services and apps with OpenInference.

AI Agents

Get visibility into Agentic AI workloads: trace execution paths, tool invocations, and inter-agent communication. Monitor and debug Agent interactions (function calling, tool-use, RAG), and resolve performance, latency, cost, and reliability issues.

OpenAI Agents logo

OpenAI Agents

Monitor and trace your OpenAI Agents.

Amazon Bedrock AgentCore logo

Amazon Bedrock AgentCore

Monitor and trace your Amazon Bedrock AgentCore Agents.

Google ADK logo

Google ADK

Monitor your Google Agent Development Kit.

LangGraph logo

LangGraph

Monitor and trace your LangChain Agents.

Pydantic AI logo

Pydantic AI

Monitor and trace your Pydantic AI agents.

MCP AI Agent monitoring logo

MCP AI Agent monitoring

Monitoring and tracing of agents communicating via MCP.

Model providers and platforms

Monitor and gain insights into the performance, consumption, latency, availability, response time, and health of the platforms used for pre-trained foundational models, agentic frameworks, and specialized AI APIs for building, training, and deploying machine learning models.

See more (16)
OpenAI logo

OpenAI

Monitoring your OpenAI & Azure OpenAI services such as GPT, o1, DALL-E, ChatGPT.

Amazon Bedrock logo

Amazon Bedrock

Observe end-to-end generative AI models provided by Amazon Bedrock.

CrewAI logo

CrewAI

Monitor CrewAI workloads and AI Agents.

Azure AI Foundry logo

Azure AI Foundry

End-to-end observability for GenAI & LLM applications build with Azure.

Anthropic logo

Anthropic

Monitor end-to-end your Anthropic services such as Haiku, Sonnet, and Opus.

Gemini logo

Gemini

Observe end-to-end multimodal AI models provided by Google Gemini.

AI Coding Agent Monitoring

Monitor coding AI agents with end‑to‑end distributed tracing, cost and performance insights, and full‑stack context, so teams can reduce token spend, resolve agent failures faster, and confidently run AI‑driven code workflows in production.

Claude Code Agent monitoring logo

Claude Code Agent monitoring

Monitor your Claude Code coding agents with OTel.

Gemini CLI Monitoring logo

Gemini CLI Monitoring

End‑to‑end visibility into Gemini CLI usage, tokens, and performance.

OpenAI Codex Monitoring logo

OpenAI Codex Monitoring

Visibility into OpenAI Codex CLI usage, tokens, and performance in Dynatrace.

Github Copilot SDK Monitoring logo

Github Copilot SDK Monitoring

End-to-end insight into Copilot SDK model calls, performance, and token usage.

OpenCode Monitoring logo

OpenCode Monitoring

Visibility into OpenCode sessions, LLM calls, tools, and performance.

OpenClaw Monitoring logo

OpenClaw Monitoring

Monitor OpenClaw agent activity with AI observability in Dynatrace.

Data management and vector stores

Monitor, optimize, and manage data ingestion, preprocessing, and storage for traditional and vector-based workflows.

See more (2)
Pinecone logo

Pinecone

Gain insight into your Pinecone vector databases to build knowledgeable AI.

LanceDB logo

LanceDB

Monitor the performance of your multimodal AI database powered by LanceDB.

Chroma logo

Chroma

Gain insights into the health of your vector and embedding databases from Chroma.

Milvus logo

Milvus

Gain insights about vector database resource utilization and cache behavior.

Weaviate logo

Weaviate

Observe your semantic cache efficiency to reduce cost and latency for LLM apps.

Qdrant logo

Qdrant

Gain insights about your Qdrant semantic vector collections.

Orchestration and Prompt Engineering Frameworks

Automate multi-step LLM workflows, manage prompt chaining, agent-based systems, and retrieval-augmented generation (RAG).

LangChain logo

LangChain

Monitor your generative AI LLM applications built by LangChain framework.

Haystack logo

Haystack

Observe your LLM applications at scale, with RAG pipeline models by Haystack.

LlamaIndex logo

LlamaIndex

Monitor your LLM-powered agents and workflows built with LlamaIndex framework.

Infrastructure and Compute Resources

Manage and monitor hardware and compute environments for training, fine-tuning, costs, and inference acceleration.

Google Cloud Tensor Processing Units logo

Google Cloud Tensor Processing Units

Observe and monitor your machine learning models built on top of Tensor Units.

TensorFlow Keras logo

TensorFlow Keras

Observe the training progress of TensorFlow Keras AI models.

NVIDIA GPU logo

NVIDIA GPU

Monitor base parameters of the GPU, including load, memory and temperature.

vLLM logo

vLLM

Monitor your services built with vLLM's inference and LLM serving solution.

Security, Governance and Traffic Management

Ensure secure, compliant, and well-routed AI traffic with transparent governance and policy enforcement.

Kong AI logo

Kong AI

Automatic, intelligent observability for Kong AI and LLM API traffic.

LiteLLM logo

LiteLLM

Automatic, intelligent observability for your LLM Gateway traffic.

More resources

Groq logo

Groq

Monitor your services built with Groq AI inference models.

Microsoft Agent Framework logo

Microsoft Agent Framework

Observe your Microsoft Agent Framework AI agents with built-in OpenTelemetry.

Are you looking for something different?

We have hundreds of apps, extensions, and other technologies to customize your environment

More resources

AI and LLM Observability

AI and LLM Observability

Leverage best-in-class observability to improve the performance, explainability, and compliance of your Generative AI applications, LLMs, and agents.
Read more
Deliver secure, safe GenAI apps with Dynatrace

Deliver secure, safe GenAI apps with Dynatrace

Amazon Bedrock, equipped with Dynatrace Davis® AI and LLM observability, gives you end-to-end insight into the Generative AI stack, from code-level visibility and performance metrics to GenAI-specific guardrails.
Read more
AI and LLM Observability Solution

AI and LLM Observability Solution

Leverage best-in-class observability to improve the performance, explainability, and compliance of your Generative AI applications, LLMs, and agents.
Read more
AI Observability Documentation

AI Observability Documentation

Documentation