Linkerd

Linkerd

LInkerd service mesh provides runtime debugging, observability, reliability, and security with zero code changes.

Extension

Free trial Documentation

Product information
Release notes

Overview

Configurations to enable dashboards and alerts for Linkerd service mesh metrics coming in through the Prometheus exporter integration. It requires metrics already ingested into Dynatrace via Prometheus integration. Follow the steps described in the Setup section for proper installation.

Use cases

Monitor Linkerd control plane performance and sidecar proxies performance
Alert on anomalies leading to performance issues
Visualize service mesh component status and performance on dashboards
Leverage Kubernetes Prometheus exporter integration to obtain all necessary telemetry data.

Get started

For more information on the installation and configuration, please see Linkerd extension in the Dynatrace Documentation.

Details

Setup

1. Enable Prometheus monitoring in Dynatrace

In your Dynatrace environment, go to Settings > Cloud and virtualization > Kubernetes and turn on Enable monitoring and Monitor Prometheus exporters. For more information see our official documentation.

2. Annotate resources to begin collecting metrics

Annotations can either be set on the services (requires ActiveGate or Dynatrace Operator 1.215+) or on the pods. If you annotate the pods directly the annotations will go away when they are destroyed so be sure to add the annotations in the pod template at the deployment or replica set level. But do not annotate the deployments themselves as this will have no effect.

Refer to documentation for annotation best practices.

Start ingesting Linkerd (control plane) metrics

Controller

This component has been removed in the latest Kubernetes releases of Linkerd, so can be skipped if you do not see a linkerd-controller service.

metrics.dynatrace.com/port: "9995"
metrics.dynatrace.com/scrape: "true"
metrics.dynatrace.com/filter: |
  {
    "mode": "include",
    "names": [
      "http_client_requests_total",
      "http_server_requests_total"
    ]
  }

Proxy injector

This is the linkerd-proxy-injector service and deployment.

metrics.dynatrace.com/port: "9995"
metrics.dynatrace.com/scrape: "true"
metrics.dynatrace.com/filter: |
  {
    "mode": "include",
    "names": [
      "http_client_requests_total",
      "proxy_inject_admission_requests_total",
      "proxy_inject_admission_responses_total"
    ]
  }

Identity

This is the linkerd-identity service and deployment.

metrics.dynatrace.com/port: "9990"
metrics.dynatrace.com/scrape: "true"
metrics.dynatrace.com/filter: |
  {
    "mode": "include",
    "names": [
      "grpc_server_handled_total",
      "grpc_server_msg_received_total",
      "grpc_server_msg_sent_total",
      "grpc_server_started_total",
      "http_client_requests_total"
    ]
  }

Destination

This may either be linkerd-destination or linkerd-dst in the latest versions.

metrics.dynatrace.com/port: "9996"
metrics.dynatrace.com/scrape: "true"
metrics.dynatrace.com/filter: |
  {
    "mode": "include",
    "names": [
      "grpc_server_handled_total",
      "grpc_server_msg_received_total",
      "grpc_server_msg_sent_total",
      "grpc_server_started_total",
      "http_client_requests_total"
    ]
  }

Service profile validator

This is the linkerd-sp-validator service and deployment. If you see a service for this component but no deployments/pods, this functionality was moved to the linkerd-destination component in the latest releases so you do not need to add annotations for this.

metrics.dynatrace.com/port: "9997"
metrics.dynatrace.com/scrape: "true"
metrics.dynatrace.com/filter: |
  {
    "mode": "include",
    "names": [
      "http_client_requests_total"
    ]
  }

Start ingesting Linkerd (data plane) metrics

Set the below annotations on on either the services in front of the pods or in the pod templates for the pods that you would like to collect Linkerd metrics for. The pods must have the sidecar proxy injected into them for the metrics to be available.

metrics.dynatrace.com/port: "4191"
metrics.dynatrace.com/scrape: "true"
metrics.dynatrace.com/filter: |
  {
    "mode": "include",
    "names": [
      "response_total",
      "request_total",
      "tcp_close_total",
      "tcp_open_total",
      "tcp_read_bytes_total",
      "tcp_write_bytes_total"
    ]
  }

After some minutes, you can verify if everything works as expected by finding Linkerd related metrics using the Dynatrace metrics browser. The metric keys included in our filter annotations will be the best to look for.

For troubleshooting and further annotation methods, see Monitor Prometheus metrics in Dynatrace documentation.

4. Add extension to environment

To add this extension to your environment click Add to environment on the page of this extension in the Dynatrace Hub. After activating the extension, select Dashboards in Dynatrace. You should now find out of the box dashboards for Linkerd - Control Plane and Linkerd - Data Plane.

5. Activate metric events for alerting

Additionally, the extension comes with a pre-configured metric event for alerting. To activate it:

From the Dynatrace navigation menu, select Settings > Anomaly detection > Custom events for alerting.
Find the following event
- Linkerd - Large number of failure responses: notifies you if more than 10 failure responses are detected in 3 minutes in any 5 minute period.
If necessary, select the Edit button to customize the event conditions.
Move the switch next an event to the On position to activate it.

Compatibility information

Requires metrics already ingested into Dynatrace via Prometheus integration. See Kubernetes Prometheus exporter integration documentation for details.

Subscribe to new releases

Copy to clipboard

Full version history

To have more information on how to install the downloaded package, please follow the instructions on this page.

ReleaseDate

Full version history

No release notes

Get data into Dynatrace

Dynatrace supports a wide range of methods for data ingestion. Below are some of the most popular ways to get data into Dynatrace and start observing your whole environment.

Start observing

Hyperscalers

Dynatrace seamlessly integrates with all of your hyperscalers and cloud environments.

OpenTelemetry

Ingest OpenTelemetry traces & metrics, pin them to a dashboard, set alarms, analyze them in the context of metric, log, and diagnostic data.

OpenPipeline

Ingest, process and persist your observability, business and security data from any source in any format and any scale.

Ingest data using Dynatrace technology

Automatically collects all observability signals with OneAgent, monitor remote extensions, or stay flexible with our versatile API ingest.

OneAgent

The simplest way to capture all observation signals automatically and in context.

ActiveGate

Route traffic, monitor clouds and remote technologies & run Synthetic monitors.

Custom Data ingest via API

Extend Dynatrace with custom ingest APIs.

Get data using these popular technologies

OpenTelemetry

Ingest and analyze OTel traces & metrics, set health alerts & view in context.

Prometheus

Unlock Prometheus power with intelligent analytics and automated insights.

Micrometer

Ingest Spring metrics and put them in context of trace, log and diagnostics data.

Telegraf

Monitor hundreds of Telegraf provided plugins and metrics with Dynatrace.

OpenTracing

Ingest and chart OpenTracing data, set alerts, and analyze everything in the context of traces, metrics, logs, and diagnostics data.

StatsD

The easiest way to get your custom application metrics into Dynatrace.

Stream Log Data

Use these popular Open Source data processing pipelines.

Logstash

Stream log data from Logstash and analyze it in Dynatrace.

Fluentd

Stream log data to Dynatrace via Fluentd for analysis.

Fluent Bit

Stream logs to Dynatrace via Fluent Bit for analysis and AI observability.

Get data from container platforms

Seamlessly monitor and trace requests of microservices in your container platforms.

See more (5)

Docker

Automated distributed tracing and metrics for microservices running in Docker.

OpenShift Control Plane

Get insights into your OpenShift control plane with metrics from its components.

containerd

Distributed tracing and metrics for services in containerd in Kubernetes.

VMware Tanzu

Harness automation and AI to simplify Kubernetes observability at scale.

Cloud Foundry

Harness automation and AI to simplify observability on Cloud Foundry at scale.

Pivotal Platform

Multi-cloud platform for the deployment, management, and continuous delivery of applications. Pivotal is now VMware Tanzu.

Get real user monitoring data from mobile and web applications

iOS

Optimize iOS app performance with real-time monitoring and UX insights.

Android

Monitor Android app stability, performance, and usage in real-time.

React Native

Monitor mobile applications built with React Native running on iOS or Android.

Mobile

Analyze real user monitoring data of mobile apps in context with the backend.

OneAgent

The simplest way to capture all observation signals automatically and in context.

ActiveGate

Route traffic, monitor clouds and remote technologies & run Synthetic monitors.

Get data from security products and tools

See more (18)

Amazon ECR

Ingest Amazon Elastic Container Registry vulnerability findings and scan events.

Google Artifact Registry

Ingest Google Artifact Registry vulnerability findings.

OCSF

Ingest security findings in Open Cybersecurity Schema Framework (OCSF) format.

Tenable

Ingest Tenable vulnerability findings, scan events, and audit logs.

Snyk

Ingest Snyk vulnerability findings, scans, and audit logs.

Sonatype Lifecycle

Ingest Sonatype vulnerability findings, scans, and audit logs.

Are you looking for something different?

We have hundreds of apps, extensions, and other technologies to customize your environment