Configure the Prometheus receiver to collect Weaviate metrics

Learn how to configure the Prometheus receiver to collect Weaviate metrics.

You can monitor the performance of Weaviate databases by configuring your Weaviate instance to send metrics to Splunk Observability Cloud. This solution uses the Prometheus receiver to collect metrics from Weaviate, which exposes a /metrics endpoint that publishes Prometheus-compatible metrics.

Complete the following steps to collect metrics from Weaviate databases.

To configure the Prometheus receiver to collect metrics from Weaviate, you must meet the following requirements:

  • You have installed Weaviate on your host or container platform. For more information, see How to install Weaviate in the Weaviate documentation.

  • You have configured your Weaviate instance to expose the /metrics endpoint, which publishes Prometheus-compatible metrics. For more information, see Enable within Weaviate in the Weaviate documentation.

  1. Deploy the Splunk Distribution of the OpenTelemetry Collector to your host or container platform:
  2. Activate the Prometheus receiver for Weaviate manually in the Splunk Distribution of the OpenTelemetry Collector configuration by making the following changes to your configuration file:
    1. Add prometheus/weaviate to the receivers section. For example:
      prometheus/weaviate:
        config:
          scrape_configs:
            - job_name: 'weaviate-metrics'
              metrics_path: /metrics
              scrape_interval: 15s
              static_configs:
                - targets: ['localhost:2112']
      
    2. Add the receiver in the metrics pipeline of the service section. For example:
      service:
        pipelines:
          metrics:
            receivers: [prometheus/weaviate]
  3. Restart the Splunk Distribution of the OpenTelemetry Collector.

Metrics and attributes

Learn about the available monitoring metrics for Weaviate databases.

For the complete list of metrics and resource attributes obtainable through Weaviate’s metric system, see the prometheus.go source file in the Weaviate GitHub repository. For a subset of notable metrics, see Obtainable Metrics in the Weaviate documentation.

These metrics fall under the default metric category in Splunk Observability Cloud.

Next steps

How to monitor your AI components after you set up Observability for AI.

After you set up data collection from supported AI components to Splunk Observability Cloud, the data populates built-in experiences that you can use to monitor and troubleshoot your AI components.

The following table describes the tools you can use to monitor and troubleshoot your AI components.
Monitoring toolUse this tool toLink to documentation
Built-in navigatorsOrient and explore different layers of your AI tech stack.
Built-in dashboardsAssess service, endpoint, and system health at a glance.
Splunk Application Performance Monitoring (APM) service map and trace viewView all of your LLM service dependency graphs and user interactions in the service map or trace view.

Monitor LLM services with Splunk APM