Skip to technology filters Skip to main content
Dynatrace Hub

Extend the platform,
empower your team.

Popular searches:
Home hero bg
WeaviateWeaviate
Weaviate

Weaviate

Observe your semantic cache efficiency to reduce cost and latency for LLM apps.

Technology
Free trialDocumentation
  • Product information

Overview

Vector databases, such as Weaviate play an important role as semantic caches within state-of-the-art Large Language Model (LLM) service stacks.

Semantic caches reduce the latency for well-known and frequent user prompts while at the same time help to reduce the overall cost of pre-trained model cloud service costs. Monitoring cache efficiency and memory utilization ensures optimal resource allocation, while adaptability to dynamic contexts measures the cache's ability to respond accurately to evolving conversation dynamics. Additionally, cache warm-up times contribute to faster availability of cached information. For vector databases, query performance and indexing speed are critical indicators, directly impacting the system's ability to handle similarity searches efficiently. Scalability, accuracy of vector representations, and storage efficiency are essential for managing growing datasets effectively. Factors such as update, and deletion performance and query throughput further contribute to the overall effectiveness of these systems in providing real-time and accurate responses in natural language processing and similarity search applications. Striking the right balance across these KPIs ensures that both semantic LLM caches and vector databases deliver optimal performance across diverse use cases. In summary, vector databases such as Weaviate aim to address performance-related challenges, enhance efficiency, and contribute to a more seamless and responsive experience in various natural language processing applications.

Get started

Setting up full stack observability for your GenAI applications is possible with Traceloop's OpenLLMetry, with OpenTelemetry under the hood, which can seamlessly provide comprehensive end-to-end insights into your production environments.

To set up OpenLLMetry with Dynatrace, see Dynatrace Documentation.

Details

Weaviate can expose Prometheus-compatible metrics for monitoring. A standard Prometheus setup can be used to visualize metrics on various dashboards in your Dynatrace environment.

Weaviate metrics are then used to measure request latencies, import speed, time spent on vector vs object storage, memory usage, application usage, and more.

Beside other measurements, Weaviate exposes following metrics that allow users to observe the health and performance of their vectorized index:

  • batch_durations_ms: a histogram type metric that represents the duration of a single batch operation in ms. The dimension ‘operation’ defines which operation the batch was performing (e.g.: object, inverted, vector) and the ‘class_name’ dimension specifies the class the batch was affecting.
  • batch_delete_durations_ms: a histogram type metric that represents the duration of batch deletions, where the dimension ‘operation’ further refines what operation was measured.
  • objects_durations_ms: a histogram type metric that represents the duration of individual operations.
  • object_count: a gauge type metric that represents the number of objects per object class.
  • async_operations_running: a gauge type metric that represents the number of currently running async operations. The operation itself is defined through the operation dimension.
  • lsm_active_segments: a gauge type metric that represents the number of currently present segments per shard within the Log-Structured-Merge Tree (LSM).
  • lsm_bloom_filter_duration_ms: a histogram type metric that represents the duration of a bloom filter operation per shard in ms within the Log-Structured-Merge Tree (LSM).
  • lsm_segment_objects: a gauge type metric that represents the number of entries per Log-Structured-Merge Tree (LSM) segment by level.
  • lsm_segment_size: a gauge type metric that represents the Log-Structured-Merge Tree (LSM) segment size.
  • lsm_segment_count: a gauge type metric that represents the number of Log-Structured-Merge Tree (LSM) segments.
  • vector_index_tombstones: a gauge type metric that represents the number of currently active tombstones in the vector index. Will go up on each incoming delete and go down after a completed repair operation.
  • vector_index_tombstone_cleanup_threads: a gauge type metric that represents the number of currently active threads for repairing/cleaning up the vector index after deletes have occurred.
  • vector_index_tombstone_cleaned: a counter type metric that represents the total number of deleted and removed vectors after repair operations.
  • vector_index_operations: a gauge type metric that represents the total number of mutating operations on the vector index. The operation itself is defined by the operation label.
  • vector_index_size: a gauge type metric that represents the total capacity of the vector index.
  • vector_index_maintenance_durations_ms: a histogram type metric that represents the duration of a sync or async vector index maintenance operation. The operation itself is defined through the operation label.
  • vector_index_durations_ms: a histogram type metric that represents the duration of regular vector index operation, such as insert or delete. The operation itself is defined through the operation label. The step label adds more granularity to each operation.
  • startup_durations_ms: a histogram type metric that represents the duration of individual startup operations in ms.
  • startup_diskio_throughput: a histogram type metric that represents the Disk I/O throughput in bytes/s at startup operations, such as reading back the HNSW index or recovering LSM segments.
  • requests_total: a gauge vector type metric that tracks all user requests to determine if it was successful or failed.
Dynatrace
Documentation
By Dynatrace
Dynatrace support center
Copy to clipboard
Dynatrace Hub
Hub HomeGet data into DynatraceBuild your own app
Dynatrace Intelligence - Agentic Operations SystemThe Dynatrace Agentic AI ecosystem
All (914)Log Management and AnalyticsKubernetesInfrastructure ObservabilitySoftware DeliveryApplication ObservabilityApplication SecurityBusiness ObservabilityDigital Experience
Filter
Type
Built and maintained by
Deployment model
SaaS
  • SaaS
  • Managed
Partner FinderBecome a partnerDynatrace Developer

AI and LLM Observability

Achieve complete visibility and insights across every layer of your AI and LLM ecosystem – from data ingestion and vector stores to agentic frameworks and prompt engineering – ensuring optimal performance, cost efficiency, compliance, and system reliability at scale.

Essentials

AI Observability logo

AI Observability

End-to-end observability for your Agentic AI and LLM workloads.

OneAgent for GenAI logo

OneAgent for GenAI

Monitor and trace your AI workloads and apps automatically with OneAgent.

OpenTelemetry for GenAI logo

OpenTelemetry for GenAI

Ingest and analyze OTel GenAI traces & metrics for your AI workloads.

OpenInference logo

OpenInference

Instrument your AI agents, services and apps with OpenInference.

AI Agents

Get visibility into Agentic AI workloads: trace execution paths, tool invocations, and inter-agent communication. Monitor and debug Agent interactions (function calling, tool-use, RAG), and resolve performance, latency, cost, and reliability issues.

OpenAI Agents logo

OpenAI Agents

Monitor and trace your OpenAI Agents.

Amazon Bedrock AgentCore logo

Amazon Bedrock AgentCore

Monitor and trace your Amazon Bedrock AgentCore Agents.

Google ADK logo

Google ADK

Monitor your Google Agent Development Kit.

LangGraph logo

LangGraph

Monitor and trace your LangChain Agents.

Pydantic AI logo

Pydantic AI

Monitor and trace your Pydantic AI agents.

MCP AI Agent monitoring logo

MCP AI Agent monitoring

Monitoring and tracing of agents communicating via MCP.

Model providers and platforms

Monitor and gain insights into the performance, consumption, latency, availability, response time, and health of the platforms used for pre-trained foundational models, agentic frameworks, and specialized AI APIs for building, training, and deploying machine learning models.

See more (16)
OpenAI logo

OpenAI

Monitoring your OpenAI & Azure OpenAI services such as GPT, o1, DALL-E, ChatGPT.

Amazon Bedrock logo

Amazon Bedrock

Observe end-to-end generative AI models provided by Amazon Bedrock.

CrewAI logo

CrewAI

Monitor CrewAI workloads and AI Agents.

Azure AI Foundry logo

Azure AI Foundry

End-to-end observability for GenAI & LLM applications build with Azure.

Anthropic logo

Anthropic

Monitor end-to-end your Anthropic services such as Haiku, Sonnet, and Opus.

Gemini logo

Gemini

Observe end-to-end multimodal AI models provided by Google Gemini.

AI Coding Agent Monitoring

Monitor coding AI agents with end‑to‑end distributed tracing, cost and performance insights, and full‑stack context, so teams can reduce token spend, resolve agent failures faster, and confidently run AI‑driven code workflows in production.

Claude Code Agent monitoring logo

Claude Code Agent monitoring

Monitor your Claude Code coding agents with OTel.

Gemini CLI Monitoring logo

Gemini CLI Monitoring

End‑to‑end visibility into Gemini CLI usage, tokens, and performance.

OpenAI Codex Monitoring logo

OpenAI Codex Monitoring

Visibility into OpenAI Codex CLI usage, tokens, and performance in Dynatrace.

Github Copilot SDK Monitoring logo

Github Copilot SDK Monitoring

End-to-end insight into Copilot SDK model calls, performance, and token usage.

OpenCode Monitoring logo

OpenCode Monitoring

Visibility into OpenCode sessions, LLM calls, tools, and performance.

OpenClaw Monitoring logo

OpenClaw Monitoring

Monitor OpenClaw agent activity with AI observability in Dynatrace.

Data management and vector stores

Monitor, optimize, and manage data ingestion, preprocessing, and storage for traditional and vector-based workflows.

See more (2)
Pinecone logo

Pinecone

Gain insight into your Pinecone vector databases to build knowledgeable AI.

LanceDB logo

LanceDB

Monitor the performance of your multimodal AI database powered by LanceDB.

Chroma logo

Chroma

Gain insights into the health of your vector and embedding databases from Chroma.

Milvus logo

Milvus

Gain insights about vector database resource utilization and cache behavior.

Weaviate logo

Weaviate

Observe your semantic cache efficiency to reduce cost and latency for LLM apps.

Qdrant logo

Qdrant

Gain insights about your Qdrant semantic vector collections.

Orchestration and Prompt Engineering Frameworks

Automate multi-step LLM workflows, manage prompt chaining, agent-based systems, and retrieval-augmented generation (RAG).

LangChain logo

LangChain

Monitor your generative AI LLM applications built by LangChain framework.

Haystack logo

Haystack

Observe your LLM applications at scale, with RAG pipeline models by Haystack.

LlamaIndex logo

LlamaIndex

Monitor your LLM-powered agents and workflows built with LlamaIndex framework.

Infrastructure and Compute Resources

Manage and monitor hardware and compute environments for training, fine-tuning, costs, and inference acceleration.

Google Cloud Tensor Processing Units logo

Google Cloud Tensor Processing Units

Observe and monitor your machine learning models built on top of Tensor Units.

TensorFlow Keras logo

TensorFlow Keras

Observe the training progress of TensorFlow Keras AI models.

NVIDIA GPU logo

NVIDIA GPU

Monitor base parameters of the GPU, including load, memory and temperature.

vLLM logo

vLLM

Monitor your services built with vLLM's inference and LLM serving solution.

Security, Governance and Traffic Management

Ensure secure, compliant, and well-routed AI traffic with transparent governance and policy enforcement.

Kong AI logo

Kong AI

Automatic, intelligent observability for Kong AI and LLM API traffic.

LiteLLM logo

LiteLLM

Automatic, intelligent observability for your LLM Gateway traffic.

More resources

Groq logo

Groq

Monitor your services built with Groq AI inference models.

Microsoft Agent Framework logo

Microsoft Agent Framework

Observe your Microsoft Agent Framework AI agents with built-in OpenTelemetry.

Are you looking for something different?

We have hundreds of apps, extensions, and other technologies to customize your environment

More resources

AI and LLM Observability

AI and LLM Observability

Leverage best-in-class observability to improve the performance, explainability, and compliance of your Generative AI applications, LLMs, and agents.
Read more
Deliver secure, safe GenAI apps with Dynatrace

Deliver secure, safe GenAI apps with Dynatrace

Amazon Bedrock, equipped with Dynatrace Davis® AI and LLM observability, gives you end-to-end insight into the Generative AI stack, from code-level visibility and performance metrics to GenAI-specific guardrails.
Read more
AI and LLM Observability Solution

AI and LLM Observability Solution

Leverage best-in-class observability to improve the performance, explainability, and compliance of your Generative AI applications, LLMs, and agents.
Read more
AI Observability Documentation

AI Observability Documentation

Documentation