Implement RdKafka getAssignment Method

[lucas-angeli-gimenes]

The getAssignment method in RdKafka is useful for verifying the health of a Kafka consumer by checking if it has active partition assignments.

Benefits:

1. Ensuring the Consumer is Active

   • A healthy consumer should have at least one assigned partition.
   • If getAssignment returns an empty list, it may indicate that the consumer is not properly connected or is not receiving partition assignments.

2. Detecting Rebalance Issues

   • Kafka dynamically reassigns partitions when consumers join or leave a group.
   • A consumer that remains without assigned partitions for an extended period might be experiencing rebalance failures.

3. Identifying Invalid States

   • If a consumer is running but has no assigned partitions, possible issues include:
     • The consumer failed to join the group.
     • Kafka has no partitions available for assignment.
     • There is a communication failure between the consumer and the broker.

4. Health Check Integration for Auto-Scaling

   • This method can be used in readiness and liveness probes to ensure that only consumers with assigned partitions remain operational, preventing idle instances.

Example Usage:

$consumer = new RdKafka\KafkaConsumer($config);

$assignment = [];
$consumer->getAssignment($assignment);

if (empty($assignment)) {
    echo "❌ No partitions assigned! The consumer might not be connected to Kafka.";
} else {
    echo "✅ Consumer is healthy! Assigned partitions: " ;
}

By incorporating getAssignment into health checks, we can improve the resilience of our Kafka consumer infrastructure and detect issues proactively.

[luizmanhani]

Lgtm

[rafascosta]

Inglês brabo!