Skip to technology filters Skip to main content
Dynatrace Hub

Extend the platform,
empower your team.

Popular searches:
Home hero bg
TensorFlow KerasTensorFlow Keras
TensorFlow Keras

TensorFlow Keras

Observe the training progress of TensorFlow Keras AI models.

Technology
Free trialDocumentation
  • Product information

Overview

TensorFlow and its user-friendly Keras sequential interface represent state-of-the-art technology for training and running deep learning models.

TensorFlow represents a general-purpose machine learning framework that allows data scientists to build, train and run all kinds of AI models on top.

TensorFlow also ships together with a convenient debugging server called TensorBoard that allows data scientists to collect and visualize all relevant training information such as logs, events, and metrics within a Web dashboard.

While TensorBoard is a great tool for local debugging of your AI model, it is not applicable for long-term observability of your running AI model in production.

As TensorBoard data collection is built on top of a flexible TensorFlow callback receiver interface, it is easy to directly send observability information about your running AI model to Dynatrace. All that is necessary is a dedicated TensorFlow callback implementation that collects the data and forwards to a Dynatrace monitoring environment.

Get started

A TensorFlow callback receiver implementation does receive important information updates during training and evaluation phase of a model. See below the implementation of a Dynatrace TensorFlow callback receiver that forwards metric data during training and evaluation of a model.

  • Create a Dynatrace environment API token with the permission scopes (metric.ingest)
  • Use the following Dynatrace TensorFlow callback receiver within your AI model and initialize it with your own Dynatrace API token and environment URL:
import tensorflow as tf
from tensorflow import keras

import requests
# Custom TensorFlow Keras callback receiver that sends the logged metrics
# to a Dynatrace monitoring environment.
# Read more about writing your own callback receiver here:
# https://www.tensorflow.org/guide/keras/custom_callback
class DynatraceKerasCallback(keras.callbacks.Callback):
    metricprefix = ''
    modelname = ''
    url = ''
    apitoken = ''
    batch = ''

    # Constructor that takes a metric prefix, the name of the current model that is used,
    # the Dynatrace metric ingest API endpoint (e.g.: https://your.live.dynatrace.com/api/v2/metrics/ingest)
    # and the Dynatrace API token (with metric ingest scope enabled)
    def __init__(self, metricprefix='tensorflow.', modelname='', url='', apitoken=''):
        self.metricprefix = metricprefix
        self.modelname = modelname
        self.url = url
        self.apitoken = apitoken

    def send_metric(self, name, value, tags):
      tags_str = ''
      for tag_key in tags:
        tags_str = tags_str + ',{key}={value}'.format(key=tag_key, value=tags[tag_key])
      line = '{prefix}.{name}{tags} {value}\n'.format(prefix=self.metricprefix, tags=tags_str, model=self.modelname, name=name, value=value)
      self.batch = self.batch + line

    def flush(self):
      print(self.batch)
      r = requests.post(self.url, headers={'Content-Type': 'text/plain', 'Authorization' : 'Api-Token ' + self.apitoken}, data=self.batch)
      self.batch = ''

    def on_train_end(self, logs=None):
        keys = list(logs.keys())
        for m in keys:
          self.send_metric(m, logs[m], { 'model' : self.modelname, 'stage' : 'train' })
        self.flush()

    def on_epoch_end(self, epoch, logs=None):
        keys = list(logs.keys())
        for m in keys:
          self.send_metric(m, logs[m], { 'model' : self.modelname, 'stage' : 'train' })
        self.flush()

    def on_test_end(self, logs=None):
        keys = list(logs.keys())
        for m in keys:
          self.send_metric(m, logs[m], { 'model' : self.modelname, 'stage' : 'test' })
        self.flush()

    def on_predict_end(self, logs=None):
        keys = list(logs.keys())
        for m in keys:
          self.send_metric(m, logs[m], { 'model' : self.modelname, 'stage' : 'predict' })
        self.flush()
  • The Dynatrace TensorFlow callback hook will prefix and forward all your TensorFlow metrics to Dynatrace. By default you will receive two metrics representing the training accuracy (tensorflow.accuracy) and the loss (tensorflow.loss) split by model and stage.
Dynatrace
Documentation
By Dynatrace
Dynatrace support center
Copy to clipboard
Dynatrace Hub
Hub HomeGet data into DynatraceBuild your own app
Dynatrace Intelligence - Agentic Operations SystemThe Dynatrace Agentic AI ecosystem
All (914)Log Management and AnalyticsKubernetesInfrastructure ObservabilitySoftware DeliveryApplication ObservabilityApplication SecurityBusiness ObservabilityDigital Experience
Filter
Type
Built and maintained by
Deployment model
SaaS
  • SaaS
  • Managed
Partner FinderBecome a partnerDynatrace Developer

AI and LLM Observability

Achieve complete visibility and insights across every layer of your AI and LLM ecosystem – from data ingestion and vector stores to agentic frameworks and prompt engineering – ensuring optimal performance, cost efficiency, compliance, and system reliability at scale.

Essentials

AI Observability logo

AI Observability

End-to-end observability for your Agentic AI and LLM workloads.

OneAgent for GenAI logo

OneAgent for GenAI

Monitor and trace your AI workloads and apps automatically with OneAgent.

OpenTelemetry for GenAI logo

OpenTelemetry for GenAI

Ingest and analyze OTel GenAI traces & metrics for your AI workloads.

OpenInference logo

OpenInference

Instrument your AI agents, services and apps with OpenInference.

AI Agents

Get visibility into Agentic AI workloads: trace execution paths, tool invocations, and inter-agent communication. Monitor and debug Agent interactions (function calling, tool-use, RAG), and resolve performance, latency, cost, and reliability issues.

OpenAI Agents logo

OpenAI Agents

Monitor and trace your OpenAI Agents.

Amazon Bedrock AgentCore logo

Amazon Bedrock AgentCore

Monitor and trace your Amazon Bedrock AgentCore Agents.

Google ADK logo

Google ADK

Monitor your Google Agent Development Kit.

LangGraph logo

LangGraph

Monitor and trace your LangChain Agents.

Pydantic AI logo

Pydantic AI

Monitor and trace your Pydantic AI agents.

MCP AI Agent monitoring logo

MCP AI Agent monitoring

Monitoring and tracing of agents communicating via MCP.

Model providers and platforms

Monitor and gain insights into the performance, consumption, latency, availability, response time, and health of the platforms used for pre-trained foundational models, agentic frameworks, and specialized AI APIs for building, training, and deploying machine learning models.

See more (16)
OpenAI logo

OpenAI

Monitoring your OpenAI & Azure OpenAI services such as GPT, o1, DALL-E, ChatGPT.

Amazon Bedrock logo

Amazon Bedrock

Observe end-to-end generative AI models provided by Amazon Bedrock.

CrewAI logo

CrewAI

Monitor CrewAI workloads and AI Agents.

Azure AI Foundry logo

Azure AI Foundry

End-to-end observability for GenAI & LLM applications build with Azure.

Anthropic logo

Anthropic

Monitor end-to-end your Anthropic services such as Haiku, Sonnet, and Opus.

Gemini logo

Gemini

Observe end-to-end multimodal AI models provided by Google Gemini.

AI Coding Agent Monitoring

Monitor coding AI agents with end‑to‑end distributed tracing, cost and performance insights, and full‑stack context, so teams can reduce token spend, resolve agent failures faster, and confidently run AI‑driven code workflows in production.

Claude Code Agent monitoring logo

Claude Code Agent monitoring

Monitor your Claude Code coding agents with OTel.

Gemini CLI Monitoring logo

Gemini CLI Monitoring

End‑to‑end visibility into Gemini CLI usage, tokens, and performance.

OpenAI Codex Monitoring logo

OpenAI Codex Monitoring

Visibility into OpenAI Codex CLI usage, tokens, and performance in Dynatrace.

Github Copilot SDK Monitoring logo

Github Copilot SDK Monitoring

End-to-end insight into Copilot SDK model calls, performance, and token usage.

OpenCode Monitoring logo

OpenCode Monitoring

Visibility into OpenCode sessions, LLM calls, tools, and performance.

OpenClaw Monitoring logo

OpenClaw Monitoring

Monitor OpenClaw agent activity with AI observability in Dynatrace.

Data management and vector stores

Monitor, optimize, and manage data ingestion, preprocessing, and storage for traditional and vector-based workflows.

See more (2)
Pinecone logo

Pinecone

Gain insight into your Pinecone vector databases to build knowledgeable AI.

LanceDB logo

LanceDB

Monitor the performance of your multimodal AI database powered by LanceDB.

Chroma logo

Chroma

Gain insights into the health of your vector and embedding databases from Chroma.

Milvus logo

Milvus

Gain insights about vector database resource utilization and cache behavior.

Weaviate logo

Weaviate

Observe your semantic cache efficiency to reduce cost and latency for LLM apps.

Qdrant logo

Qdrant

Gain insights about your Qdrant semantic vector collections.

Orchestration and Prompt Engineering Frameworks

Automate multi-step LLM workflows, manage prompt chaining, agent-based systems, and retrieval-augmented generation (RAG).

LangChain logo

LangChain

Monitor your generative AI LLM applications built by LangChain framework.

Haystack logo

Haystack

Observe your LLM applications at scale, with RAG pipeline models by Haystack.

LlamaIndex logo

LlamaIndex

Monitor your LLM-powered agents and workflows built with LlamaIndex framework.

Infrastructure and Compute Resources

Manage and monitor hardware and compute environments for training, fine-tuning, costs, and inference acceleration.

Google Cloud Tensor Processing Units logo

Google Cloud Tensor Processing Units

Observe and monitor your machine learning models built on top of Tensor Units.

TensorFlow Keras logo

TensorFlow Keras

Observe the training progress of TensorFlow Keras AI models.

NVIDIA GPU logo

NVIDIA GPU

Monitor base parameters of the GPU, including load, memory and temperature.

vLLM logo

vLLM

Monitor your services built with vLLM's inference and LLM serving solution.

Security, Governance and Traffic Management

Ensure secure, compliant, and well-routed AI traffic with transparent governance and policy enforcement.

Kong AI logo

Kong AI

Automatic, intelligent observability for Kong AI and LLM API traffic.

LiteLLM logo

LiteLLM

Automatic, intelligent observability for your LLM Gateway traffic.

More resources

Groq logo

Groq

Monitor your services built with Groq AI inference models.

Microsoft Agent Framework logo

Microsoft Agent Framework

Observe your Microsoft Agent Framework AI agents with built-in OpenTelemetry.

Are you looking for something different?

We have hundreds of apps, extensions, and other technologies to customize your environment

More resources

AI and LLM Observability

AI and LLM Observability

Leverage best-in-class observability to improve the performance, explainability, and compliance of your Generative AI applications, LLMs, and agents.
Read more
Deliver secure, safe GenAI apps with Dynatrace

Deliver secure, safe GenAI apps with Dynatrace

Amazon Bedrock, equipped with Dynatrace Davis® AI and LLM observability, gives you end-to-end insight into the Generative AI stack, from code-level visibility and performance metrics to GenAI-specific guardrails.
Read more
AI and LLM Observability Solution

AI and LLM Observability Solution

Leverage best-in-class observability to improve the performance, explainability, and compliance of your Generative AI applications, LLMs, and agents.
Read more
AI Observability Documentation

AI Observability Documentation

Documentation