This allows for the collection of Kafka Lag metrics and exposing them as Prometheus metrics. Please, edit or remove the exporters part and I'll accept it. The kafkaexporterconfig block configures the kafkaexporter integration, which is an embedded version of kafkaexporter. The first part of your answer seems to hit the nail on the head though. For example, a 16-node Kubernetes cluster with 16 Cloud Native Application Observability Distribution for OpenTelemetry™ Collector replicas can handle a total of 80,000 Kafka partitions. I am not able to export " typeconnector-metrics" metrics for Confluent connect service but other metrics are working fine. From what I can see all Prometheus exporters are about exporting data from various data sources and importing it into Prometheus, which is the opposite of what I described in my question.
#Kafka connect prometheus exporter how to#
To process additional partitions, add one Cloud Native Application Observability Distribution for OpenTelemetry™ Collector replica for every 5,000 partitions. Install the Kafka exporter Define a PodMonitoring resource Define rules and alerts Verify the configuration View dashboards Troubleshooting This document describes how to configure your Google. This limit ensures that you have enough storage for Cloud Native Application Observability metrics, events, logs, and traces (MELT) data. See Prometheus Exporters and integrations.Įach Cloud Native Application Observability Distribution for OpenTelemetry™ Collector replica can process 5,000 Kafka partitions. If you don’t have the Cloud Native Application Observability Helm chart installed, see Install Kubernetes and App Service Monitoring.īefore you integrate Prometheus, you must h ave configured Kafka and JMX exporters in your environment. kafkaconnectexporter: -listen-address string Address on which to expose metrics.
#Kafka connect prometheus exporter software#
The Cloud Native Application Observability Helm chart package provides all the necessary dependencies. A Prometheus exporter that collects Kafka connect metrics. Kafka is an open-source stream-processing software platform written in Scala and Java. This page explains how to use add the Kafka Prometheus exporter within your deployed environment using Helm Charts. This document describes how to configure your Google Kubernetes Engine deployment so that you can use Google Cloud Managed Service for Prometheus to collect. DescriptionConfluent Kafka Broker Afternetwork.target network-online.target remote-fs.
0 kommentar(er)
