--- title: OpenTelemetry Kafka metrics reference source: https://docs.newrelic.com/docs/opentelemetry/integrations/kafka/metrics-reference --- This page documents the metrics collected when monitoring Apache Kafka with OpenTelemetry. Metrics are collected via the [Kafka metrics receiver](https://github.com/open-telemetry/opentelemetry-collector-contrib/tree/main/receiver/kafkametricsreceiver), JMX metrics (from OpenTelemetry Java Agent or Prometheus JMX Exporter), and [OpenTelemetry Java agent](https://opentelemetry.io/docs/languages/java/automatic/) for client-side metrics. ## Metric collection methods [#collection-methods] OpenTelemetry Kafka monitoring uses two complementary collection methods: - **[Kafka metrics receiver](https://github.com/open-telemetry/opentelemetry-collector-contrib/tree/main/receiver/kafkametricsreceiver)**: Connects to Kafka's bootstrap port to collect cluster, topic, partition, and consumer group metrics - **JMX metrics**: Collected via OpenTelemetry Java Agent (self-hosted) or Prometheus JMX Exporter (Kubernetes) to gather detailed broker metrics and JVM metrics ## Kafka metrics receiver metrics [#kafka-metrics-receiver] These metrics are collected from Kafka brokers using the Kafka protocol (bootstrap port). Based on the [kafkametricsreceiver metadata](https://github.com/open-telemetry/opentelemetry-collector-contrib/blob/main/receiver/kafkametricsreceiver/metadata.yaml), with some metrics disabled by default or in typical configurations. **Cluster metrics** | Metric name | Description | Type | | --------------- | -------------------------------------- | ----------- | | `kafka.brokers` | Total number of brokers in the cluster | Gauge (int) | **Topic metrics** | Metric name | Description | Type | Attributes | | --------------------------------- | ----------------------------------- | ----------- | ---------- | | `kafka.topic.partitions` | Number of partitions in topic | Sum (int) | topic | | `kafka.topic.min_insync_replicas` | Minimum in-sync replicas of a topic | Gauge (int) | topic | | `kafka.topic.replication_factor` | Replication factor of a topic | Gauge (int) | topic | **Partition metrics** | Metric name | Description | Type | Attributes | | ---------------------------------------- | --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- | --------- | ---------------- | | `kafka.partition.replicas_in_sync` | Number of in-sync replicas for a partition. This metric is filtered out by the collector pipeline — only the aggregated `kafka.partition.replicas_in_sync.total` per topic is retained. | Sum (int) | topic, partition | | `kafka.partition.replicas_in_sync.total` | Total number of in-sync replicas aggregated across all partitions for a topic | Sum (int) | topic | **Consumer group metrics** | Metric name | Description | Type | Attributes | | --------------------------------- | ---------------------------------------------------------------------------- | ----------- | ----------------------- | | `kafka.consumer_group.members` | Count of members in the consumer group | Sum (int) | group | | `kafka.consumer_group.offset` | Current offset of the consumer group at partition of topic | Gauge (int) | group, topic, partition | | `kafka.consumer_group.offset_sum` | Sum of consumer group offset across partitions of topic | Gauge (int) | group, topic | | `kafka.consumer_group.lag` | Current approximate lag of consumer group at partition of topic | Gauge (int) | group, topic, partition | | `kafka.consumer_group.lag_sum` | Current approximate sum of consumer group lag across all partitions of topic | Gauge (int) | group, topic | ## JMX metrics [#jmx-metrics] JMX metrics provide detailed Kafka broker and JVM telemetry. These metrics are collected using: - **Self-hosted Kafka**: [OpenTelemetry Java Agent](https://docs.newrelic.com/docs/opentelemetry/integrations/kafka/self-hosted#java-agent) or [Prometheus JMX Exporter](https://docs.newrelic.com/docs/opentelemetry/integrations/kafka/self-hosted#prometheus) - **Kubernetes (self-managed)**: [OpenTelemetry Java Agent](https://docs.newrelic.com/docs/opentelemetry/integrations/kafka/kubernetes-self-managed#java-agent) or [Prometheus JMX Exporter](https://docs.newrelic.com/docs/opentelemetry/integrations/kafka/kubernetes-self-managed#prometheus) - **Kubernetes (Strimzi)**: [Prometheus JMX Exporter](https://docs.newrelic.com/docs/opentelemetry/integrations/kafka/kubernetes-strimzi#configure-jmx-exporter) with New Relic custom configuration Both methods collect the same set of Kafka broker and JVM metrics documented below: **Kafka broker metrics** These metrics provide comprehensive Kafka broker telemetry including cluster health, broker performance, and per-topic metrics. ### Cluster-wide metrics These metrics are collected from the controller broker and provide cluster-wide information: | Metric name | Description | Type | | -------------------------------------- | ------------------------------------------------------------------------------------------------------ | ------- | | `kafka.partition.offline` | The number of partitions offline in the cluster | Gauge | | `kafka.leader.election.rate` | The leader election count. Only appears when a leader election occurs; not emitted on stable clusters. | Counter | | `kafka.unclean.election.rate` | Unclean leader election count - increasing indicates broker failures | Counter | | `kafka.cluster.topic.count` | The total number of topics in the cluster | Gauge | | `kafka.cluster.partition.count` | The total number of partitions in the cluster | Gauge | | `kafka.broker.fenced.count` | The number of fenced brokers in the cluster | Gauge | | `kafka.partition.non_preferred_leader` | The count of topic partitions for which the leader is not the preferred leader | Gauge | ### Broker-level metrics | Metric name | Description | Type | | ---------------------------------- | -------------------------------------------------------------------------------------- | ------- | | `kafka.message.count` | The number of messages received by the broker | Counter | | `kafka.request.count` | The number of requests received by the broker | Counter | | `kafka.request.failed` | The number of failed requests | Counter | | `kafka.request.time.total` | The total time spent processing requests (ms) | Counter | | `kafka.request.time.avg` | Average request processing time (ms) | Gauge | | `kafka.request.time.50p` | 50th percentile request time (ms) | Gauge | | `kafka.request.time.99p` | 99th percentile request time (ms) | Gauge | | `kafka.network.io` | Bytes received or sent by broker per second (includes direction attribute: in/out) | Counter | | `kafka.purgatory.size` | The number of requests waiting in purgatory (Produce and Fetch operations) | Gauge | | `kafka.partition.count` | The number of partitions on the broker | Gauge | | `kafka.partition.under_replicated` | The number of under-replicated partitions on this broker | Gauge | | `kafka.isr.operation.count` | In-sync replica operations (shrink or expand) | Counter | | `kafka.max.lag` | Maximum lag between follower and leader replicas | Gauge | | `kafka.controller.active.count` | Whether this broker is the active controller (0 or 1) | Gauge | | `kafka.logs.flush.count` | Log flush count | Counter | | `kafka.logs.flush.time.50p` | Log flush time - 50th percentile (ms) | Gauge | | `kafka.logs.flush.time.99p` | Log flush time - 99th percentile (ms) | Gauge | | `kafka.partition.under_min_isr` | The number of partitions where the number of in-sync replicas is less than the minimum | Gauge | | `kafka.broker.uptime` | Broker uptime (ms) | Gauge | | `kafka.broker.leader.count` | Number of partitions for which this broker is the leader | Gauge | | `kafka.request.queue` | Size of the request queue on the broker | Gauge | **Attributes:** Many metrics include `type` attribute indicating request type (e.g., fetch, produce), or `state` for ISR operations (e.g., shrink, expand), or `direction` for network I/O (in, out). ### Per-topic metrics | Metric name | Description | Type | Attributes | | ---------------------- | ----------------------------------------- | ------- | ------------------------- | | `kafka.prod.msg.count` | The number of messages received per topic | Counter | topic | | `kafka.topic.io` | The bytes received or sent per topic | Counter | topic, direction (in/out) | **JVM metrics** | Metric name | Description | Type | | ------------------------------------ | --------------------------------------------------------------------- | ------- | | `jvm.memory.heap.used` | Current heap memory used (bytes) | Gauge | | `jvm.memory.heap.max` | Maximum heap memory available (bytes) | Gauge | | `jvm.memory.heap.committed` | Committed heap memory (bytes) | Gauge | | `jvm.gc.collections.count` | Total number of garbage collections that have occurred | Counter | | `jvm.gc.collections.elapsed` | The approximate accumulated collection elapsed time (ms) | Counter | | `jvm.thread.count` | Total thread count (Kafka typical range 100-300 threads) | Gauge | | `jvm.system.cpu.load_1m` | System load average (1 minute) - alert if greater than CPU count | Gauge | | `jvm.cpu.count` | Number of processors available | Gauge | | `jvm.cpu.recent_utilization` | Recent CPU utilization for JVM process (0.0 to 1.0) | Gauge | | `jvm.system.cpu.utilization` | Recent CPU utilization for whole system (0.0 to 1.0) | Gauge | | `jvm.file_descriptor.count` | Number of open file descriptors - alert if greater than 80% of ulimit | Gauge | | `jvm.class.count` | Currently loaded class count | Gauge | | `jvm.memory.pool.used` | Memory pool usage by generation (G1 Old Gen, Eden, Survivor) in bytes | Gauge | | `jvm.memory.pool.max` | Maximum memory pool size (bytes) | Gauge | | `jvm.memory.pool.used_after_last_gc` | Memory used after last GC - shows retained memory baseline (bytes) | Gauge | **Attributes:** JVM metrics include attributes like `name` (for GC collector names or memory pool names). ## Kafka client metrics [#kafka-client-metrics] These metrics are collected from Kafka producer and consumer applications instrumented with the [OpenTelemetry Java agent](https://opentelemetry.io/docs/languages/java/automatic/) with Kafka instrumentation enabled. These provide client-side visibility into application interactions with Kafka brokers and complement the broker-side metrics by providing the application perspective. **Producer metrics** ### Connection and network metrics | Metric name | Description | Attributes | | ------------------------------------------ | ----------------------------------------------- | ------------------ | | `kafka.producer.connection_count` | Number of active connections | client-id | | `kafka.producer.connection_creation_rate` | Rate of new connections established | client-id | | `kafka.producer.connection_creation_total` | Total connections created | client-id | | `kafka.producer.connection_close_rate` | Rate of connections closed | client-id | | `kafka.producer.network_io_rate` | Rate of network operations | client-id | | `kafka.producer.network_io_total` | Total network operations | client-id | | `kafka.producer.outgoing_byte_rate` | Rate of outgoing bytes | client-id, node-id | | `kafka.producer.outgoing_byte_total` | Total outgoing bytes | client-id, node-id | | `kafka.producer.incoming_byte_rate` | Rate of incoming bytes (responses from brokers) | client-id, node-id | | `kafka.producer.incoming_byte_total` | Total incoming bytes (responses from brokers) | client-id, node-id | ### Request and response metrics | Metric name | Description | Attributes | | ------------------------------------ | ---------------------------- | ------------------ | | `kafka.producer.request_rate` | Rate of requests sent | client-id, node-id | | `kafka.producer.request_total` | Total requests sent | client-id, node-id | | `kafka.producer.request_size_avg` | Average request size | client-id, node-id | | `kafka.producer.request_size_max` | Maximum request size | client-id, node-id | | `kafka.producer.request_latency_avg` | Average request latency (ms) | client-id, node-id | | `kafka.producer.request_latency_max` | Maximum request latency (ms) | client-id, node-id | | `kafka.producer.response_rate` | Rate of responses received | client-id, node-id | | `kafka.producer.response_total` | Total responses received | client-id, node-id | | `kafka.producer.requests_in_flight` | Number of in-flight requests | client-id | ### Record metrics | Metric name | Description | Attributes | | ---------------------------------------- | ---------------------------------------------- | ---------------- | | `kafka.producer.record_send_rate` | Rate of records sent | client-id, topic | | `kafka.producer.record_send_total` | Total records sent | client-id, topic | | `kafka.producer.record_error_rate` | Rate of record send errors | client-id, topic | | `kafka.producer.record_error_total` | Total record send errors | client-id, topic | | `kafka.producer.record_retry_rate` | Rate of record retries | client-id, topic | | `kafka.producer.record_retry_total` | Total record retries | client-id, topic | | `kafka.producer.record_size_avg` | Average record size | client-id | | `kafka.producer.record_size_max` | Maximum record size | client-id | | `kafka.producer.record_queue_time_avg` | Average time records spend in send buffer (ms) | client-id | | `kafka.producer.record_queue_time_max` | Maximum time records spend in send buffer (ms) | client-id | | `kafka.producer.records_per_request_avg` | Average records per request | client-id | ### Throughput metrics | Metric name | Description | Attributes | | ------------------------------------- | ------------------------- | ---------------- | | `kafka.producer.byte_rate` | Rate of bytes produced | client-id, topic | | `kafka.producer.byte_total` | Total bytes produced | client-id, topic | | `kafka.producer.compression_rate` | Average compression rate | client-id, topic | | `kafka.producer.compression_rate_avg` | Average compression ratio | client-id | ### Batching metrics | Metric name | Description | Attributes | | ---------------------------------- | -------------------- | ---------- | | `kafka.producer.batch_size_avg` | Average batch size | client-id | | `kafka.producer.batch_size_max` | Maximum batch size | client-id | | `kafka.producer.batch_split_rate` | Rate of batch splits | client-id | | `kafka.producer.batch_split_total` | Total batch splits | client-id | ### Buffer metrics | Metric name | Description | Attributes | | ------------------------------------------- | ----------------------------------------- | ---------- | | `kafka.producer.buffer_total_bytes` | Total buffer memory | client-id | | `kafka.producer.buffer_available_bytes` | Available buffer memory | client-id | | `kafka.producer.buffer_exhausted_rate` | Rate of buffer exhaustion | client-id | | `kafka.producer.buffer_exhausted_total` | Total buffer exhaustions | client-id | | `kafka.producer.bufferpool_wait_ratio` | Fraction of time waiting for buffer space | client-id | | `kafka.producer.bufferpool_wait_time_total` | Total time waiting for buffer space | client-id | ### I/O metrics | Metric name | Description | Attributes | | ------------------------------------ | -------------------------------- | ---------- | | `kafka.producer.io_ratio` | Fraction of time spent in I/O | client-id | | `kafka.producer.io_time_ns_avg` | Average I/O time (ns) | client-id | | `kafka.producer.io_wait_time_ns_avg` | Average I/O wait time (ns) | client-id | | `kafka.producer.io_wait_ratio` | Fraction of time waiting for I/O | client-id | | `kafka.producer.iotime_total` | Total I/O time | client-id | | `kafka.producer.io_waittime_total` | Total I/O wait time | client-id | ### Throttling metrics | Metric name | Description | Attributes | | ------------------------------------------ | -------------------------- | ---------- | | `kafka.producer.produce_throttle_time_avg` | Average throttle time (ms) | client-id | | `kafka.producer.produce_throttle_time_max` | Maximum throttle time (ms) | client-id | ### Authentication metrics | Metric name | Description | Attributes | | ---------------------------------------------------------- | --------------------------------------------------- | ---------- | | `kafka.producer.successful_authentication_rate` | Rate of successful authentications | client-id | | `kafka.producer.successful_authentication_total` | Total successful authentications | client-id | | `kafka.producer.successful_authentication_no_reauth_total` | Successful authentications without reauthentication | client-id | | `kafka.producer.successful_reauthentication_rate` | Rate of successful reauthentications | client-id | | `kafka.producer.successful_reauthentication_total` | Total successful reauthentications | client-id | | `kafka.producer.failed_authentication_rate` | Rate of failed authentications | client-id | | `kafka.producer.failed_authentication_total` | Total failed authentications | client-id | | `kafka.producer.failed_reauthentication_rate` | Rate of failed reauthentications | client-id | | `kafka.producer.failed_reauthentication_total` | Total failed reauthentications | client-id | | `kafka.producer.reauthentication_latency_avg` | Average reauthentication latency (ms) | client-id | | `kafka.producer.reauthentication_latency_max` | Maximum reauthentication latency (ms) | client-id | ### Miscellaneous metrics | Metric name | Description | Attributes | | -------------------------------- | ------------------------------------------ | ---------- | | `kafka.producer.metadata_age` | Age of current metadata (seconds) | client-id | | `kafka.producer.waiting_threads` | Number of threads waiting for buffer space | client-id | | `kafka.producer.select_rate` | Rate of select calls | client-id | | `kafka.producer.select_total` | Total select calls | client-id | **Consumer metrics** ### Connection and network metrics | Metric name | Description | Attributes | | ------------------------------------------ | ----------------------------------- | ------------------ | | `kafka.consumer.connection_count` | Number of active connections | client-id | | `kafka.consumer.connection_creation_rate` | Rate of new connections established | client-id | | `kafka.consumer.connection_creation_total` | Total connections created | client-id | | `kafka.consumer.connection_close_rate` | Rate of connections closed | client-id | | `kafka.consumer.connection_close_total` | Total connections closed | client-id | | `kafka.consumer.network_io_rate` | Rate of network operations | client-id | | `kafka.consumer.network_io_total` | Total network operations | client-id | | `kafka.consumer.outgoing_byte_rate` | Rate of outgoing bytes | client-id, node-id | | `kafka.consumer.incoming_byte_rate` | Rate of incoming bytes | client-id, node-id | ### Request and response metrics | Metric name | Description | Attributes | | ------------------------------------ | ---------------------------- | ------------------ | | `kafka.consumer.request_rate` | Rate of requests sent | client-id, node-id | | `kafka.consumer.request_total` | Total requests sent | client-id, node-id | | `kafka.consumer.request_size_avg` | Average request size | client-id, node-id | | `kafka.consumer.request_size_max` | Maximum request size | client-id, node-id | | `kafka.consumer.request_latency_avg` | Average request latency (ms) | client-id, node-id | | `kafka.consumer.request_latency_max` | Maximum request latency (ms) | client-id, node-id | | `kafka.consumer.response_rate` | Rate of responses received | client-id, node-id | | `kafka.consumer.response_total` | Total responses received | client-id, node-id | ### Consumption metrics | Metric name | Description | Attributes | | ---------------------------------------- | --------------------------- | ---------------- | | `kafka.consumer.bytes_consumed_rate` | Rate of bytes consumed | client-id, topic | | `kafka.consumer.bytes_consumed_total` | Total bytes consumed | client-id, topic | | `kafka.consumer.records_consumed_rate` | Rate of records consumed | client-id, topic | | `kafka.consumer.records_consumed_total` | Total records consumed | client-id, topic | | `kafka.consumer.records_per_request_avg` | Average records per request | client-id, topic | ### Consumer lag metrics | Metric name | Description | Attributes | | --------------------------------- | --------------------------------- | --------------------------- | | `kafka.consumer.records_lag` | Current lag in number of records | partition, client-id, topic | | `kafka.consumer.records_lag_avg` | Average consumer lag | partition, client-id, topic | | `kafka.consumer.records_lag_max` | Maximum consumer lag | partition, client-id, topic | | `kafka.consumer.records_lead` | Current lead in number of records | partition, client-id, topic | | `kafka.consumer.records_lead_avg` | Average consumer lead | partition, client-id, topic | | `kafka.consumer.records_lead_min` | Minimum consumer lead | partition, client-id, topic | ### Fetch metrics | Metric name | Description | Attributes | | ---------------------------------------- | -------------------------------- | ---------------- | | `kafka.consumer.fetch_rate` | Rate of fetch requests | client-id | | `kafka.consumer.fetch_total` | Total fetch requests | client-id | | `kafka.consumer.fetch_size_avg` | Average fetch size | client-id, topic | | `kafka.consumer.fetch_size_max` | Maximum fetch size | client-id, topic | | `kafka.consumer.fetch_latency_avg` | Average fetch latency (ms) | client-id | | `kafka.consumer.fetch_latency_max` | Maximum fetch latency (ms) | client-id | | `kafka.consumer.fetch_throttle_time_avg` | Average fetch throttle time (ms) | client-id | | `kafka.consumer.fetch_throttle_time_max` | Maximum fetch throttle time (ms) | client-id | ### Consumer group coordination metrics | Metric name | Description | Attributes | | -------------------------------------------- | ------------------------------------ | ---------- | | `kafka.consumer.assigned_partitions` | Number of partitions assigned | client-id | | `kafka.consumer.commit_rate` | Rate of offset commits | client-id | | `kafka.consumer.commit_total` | Total offset commits | client-id | | `kafka.consumer.commit_latency_avg` | Average commit latency (ms) | client-id | | `kafka.consumer.commit_latency_max` | Maximum commit latency (ms) | client-id | | `kafka.consumer.heartbeat_rate` | Rate of heartbeats sent | client-id | | `kafka.consumer.heartbeat_total` | Total heartbeats sent | client-id | | `kafka.consumer.heartbeat_response_time_max` | Maximum heartbeat response time (ms) | client-id | | `kafka.consumer.last_heartbeat_seconds_ago` | Seconds since last heartbeat | client-id | | `kafka.consumer.last_poll_seconds_ago` | Seconds since last poll | client-id | ### Rebalance metrics | Metric name | Description | Attributes | | ----------------------------------------------- | ----------------------------------------------------------------------------------------- | ---------- | | `kafka.consumer.rebalance_total` | Total rebalances | client-id | | `kafka.consumer.rebalance_rate_per_hour` | Rebalances per hour | client-id | | `kafka.consumer.rebalance_latency_avg` | Average rebalance latency (ms) | client-id | | `kafka.consumer.rebalance_latency_max` | Maximum rebalance latency (ms) | client-id | | `kafka.consumer.rebalance_latency_total` | Total rebalance time (ms) | client-id | | `kafka.consumer.failed_rebalance_total` | Total failed rebalances | client-id | | `kafka.consumer.failed_rebalance_rate_per_hour` | Failed rebalances per hour | client-id | | `kafka.consumer.last_rebalance_seconds_ago` | Seconds since last rebalance | client-id | | `kafka.consumer.partition_assigned_latency_avg` | Average partition assignment latency (ms). Only emitted during consumer group rebalances. | client-id | | `kafka.consumer.partition_assigned_latency_max` | Maximum partition assignment latency (ms). Only emitted during consumer group rebalances. | client-id | | `kafka.consumer.partition_revoked_latency_avg` | Average partition revocation latency (ms). Only emitted during consumer group rebalances. | client-id | | `kafka.consumer.partition_revoked_latency_max` | Maximum partition revocation latency (ms). Only emitted during consumer group rebalances. | client-id | | `kafka.consumer.partition_lost_latency_avg` | Average partition loss latency (ms). Only emitted during consumer group rebalances. | client-id | | `kafka.consumer.partition_lost_latency_max` | Maximum partition loss latency (ms). Only emitted during consumer group rebalances. | client-id | ### Sync group metrics | Metric name | Description | Attributes | | ------------------------------ | ---------------------- | ---------- | | `kafka.consumer.sync_rate` | Rate of group syncs | client-id | | `kafka.consumer.sync_total` | Total group syncs | client-id | | `kafka.consumer.sync_time_avg` | Average sync time (ms) | client-id | | `kafka.consumer.sync_time_max` | Maximum sync time (ms) | client-id | | `kafka.consumer.join_rate` | Rate of group joins | client-id | | `kafka.consumer.join_total` | Total group joins | client-id | | `kafka.consumer.join_time_avg` | Average join time (ms) | client-id | | `kafka.consumer.join_time_max` | Maximum join time (ms) | client-id | ### I/O metrics | Metric name | Description | Attributes | | ------------------------------------ | -------------------------------- | ---------- | | `kafka.consumer.io_ratio` | Fraction of time spent in I/O | client-id | | `kafka.consumer.io_time_ns_avg` | Average I/O time (ns) | client-id | | `kafka.consumer.io_wait_time_ns_avg` | Average I/O wait time (ns) | client-id | | `kafka.consumer.io_wait_ratio` | Fraction of time waiting for I/O | client-id | | `kafka.consumer.iotime_total` | Total I/O time | client-id | | `kafka.consumer.io_waittime_total` | Total I/O wait time | client-id | ### Polling metrics | Metric name | Description | Attributes | | -------------------------------------- | ----------------------------------------------------- | ---------- | | `kafka.consumer.poll_idle_ratio_avg` | Average fraction of time consumer is idle during poll | client-id | | `kafka.consumer.time_between_poll_avg` | Average time between polls (ms) | client-id | | `kafka.consumer.time_between_poll_max` | Maximum time between polls (ms) | client-id | ### Authentication metrics | Metric name | Description | Attributes | | ---------------------------------------------------------- | --------------------------------------------------- | ---------- | | `kafka.consumer.successful_authentication_rate` | Rate of successful authentications | client-id | | `kafka.consumer.successful_authentication_total` | Total successful authentications | client-id | | `kafka.consumer.successful_authentication_no_reauth_total` | Successful authentications without reauthentication | client-id | | `kafka.consumer.successful_reauthentication_rate` | Rate of successful reauthentications | client-id | | `kafka.consumer.successful_reauthentication_total` | Total successful reauthentications | client-id | | `kafka.consumer.failed_authentication_rate` | Rate of failed authentications | client-id | | `kafka.consumer.failed_authentication_total` | Total failed authentications | client-id | | `kafka.consumer.failed_reauthentication_rate` | Rate of failed reauthentications | client-id | | `kafka.consumer.failed_reauthentication_total` | Total failed reauthentications | client-id | | `kafka.consumer.reauthentication_latency_avg` | Average reauthentication latency (ms) | client-id | | `kafka.consumer.reauthentication_latency_max` | Maximum reauthentication latency (ms) | client-id | ### Miscellaneous metrics | Metric name | Description | Attributes | | ----------------------------- | -------------------- | ---------- | | `kafka.consumer.select_rate` | Rate of select calls | client-id | | `kafka.consumer.select_total` | Total select calls | client-id | ## Metric attributes [#metric-attributes] Metrics can be filtered and grouped using the following attributes: **Common attributes:** - `kafka.cluster.name` - Name of the Kafka cluster (all metrics) - `instrumentation.provider` - Always `opentelemetry` (all metrics) - `topic` - Kafka topic name - `partition` - Partition number - `group` - Consumer group name - `broker.id` - Broker identifier (JMX metrics) - `client-id` - Client identifier (client metrics) - `node-id` - Broker node identifier (client metrics) - `type` - Request type (e.g., fetch, produce) - `direction` - Data direction (in, out) - `state` - ISR operation state (shrink, expand) - `name` - GC collector or memory pool name (JVM metrics) ## Next steps [#next-steps] - [Query and visualize your data](https://docs.newrelic.com/docs/opentelemetry/integrations/kafka/find-and-query-data) - Find metrics in New Relic UI, write NRQL queries, create dashboards, and set up alerts - [Query metric data types](https://docs.newrelic.com/docs/data-apis/understand-data/metric-data/query-metric-data-type/) - Learn advanced techniques for working with OpenTelemetry metrics