kafka消费端Attempt to heartbeat failed since group is rebalancing

一、日志打印生产对接，启动消费端出现Attempt to heartbeat failed since group is rebalancing，它是kafka消费者组的心跳机制，用于检测超时不能工作的消费这。当有新的消费者加入的时候，kafka消费者组启动rebalance机制，即重平衡，重新分配资源。同时检测组内消费者成员是否可以正常工作。如果心跳检测失败，则会报Attempt to hear

温柔已看透

23661人浏览 · 2021-08-03 18:19:06

温柔已看透 · 2021-08-03 18:19:06 发布

解读

生产对接，启动消费端出现Attempt to heartbeat failed since group is rebalancing，它是kafka消费者组的心跳机制，用于检测超时不能工作的消费者。
当有新的消费者加入的时候，kafka消费者组启动rebalance机制，即重平衡，重新分配资源。同时检测组内消费者成员是否可以正常工作。如果心跳检测失败，则会报Attempt to heartbeat failed since group is rebalancing

2021-07-21 15:58:58.574  INFO 18804 --- [ronmental-group] o.a.k.c.c.internals.AbstractCoordinator  : [Consumer clientId=consumer-4, groupId=ds-BEnvironmental-group] Attempt to heartbeat failed since group is rebalancing
2021-07-21 15:59:01.611  INFO 18804 --- [ronmental-group] o.a.k.c.c.internals.AbstractCoordinator  : [Consumer clientId=consumer-4, groupId=ds-BEnvironmental-group] Attempt to heartbeat failed since group is rebalancing
2021-07-21 15:59:04.636  INFO 18804 --- [ronmental-group] o.a.k.c.c.internals.AbstractCoordinator  : [Consumer clientId=consumer-4, groupId=ds-BEnvironmental-group] Attempt to heartbeat failed since group is rebalancing

当超过max.poll.interval.ms这个时间时，消费者组会放弃检测，将消费者从组内剔除，出现下图异常信息

This member will leave the group because consumer poll timeout has expired. This means the time between subsequent calls to poll() was longer than the configured max.poll.interval.ms, which typically implies that the poll loop is spending too much time processing messages. You can address this either by increasing max.poll.interval.ms or by reducing the maximum size of batches returned in poll() with max.poll.records.