合流Kafka Python错误：元数据请求失败

Question

下面是一个错误。不知道怎么了

%5|1591739081.630|REQTMOUT|rdkafka#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator/290: Timed out HeartbeatRequest in flight (after 10622ms, timeout #0)
%4|1591739081.630|REQTMOUT|rdkafka#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator/290: Timed out 1 in-flight, 0 retry-queued, 0 out-queue, 0 partially-sent requests
%4|1591739094.726|METADATA|rdkafka#consumer-1| [thrd:main]: GroupCoordinator/289: Metadata request failed: partition assignor: Local: Broker node update (-336618544ms): Permanent

Answer 1

据我所知，这个错误来自于经纪人的胆怯

它基于消费者的session.timeout.ms，默认值为10000，这意味着如果消费者无法在10秒内完成心跳，他将被踢出

消费者尝试每heartbeat.interval.ms毫秒发送一次心跳信号，默认情况下是每3秒发送一次

因此，假设你与borkers有关联问题，持续10秒以上，你可能被踢出小组，消费者关门了

从librdkafka文档中，关于session.timeout.ms：

Client group session and failure detection timeout. The consumer sends periodic heartbeats (heartbeat.interval.ms) to indicate its liveness to the broker. If no hearts are received by the broker for a group member within the session timeout, the broker will remove the consumer from the group and trigger a rebalance. The allowed range is configured with the broker configuration properties group.min.session.timeout.ms and group.max.session.timeout.ms. Also see max.poll.interval.ms. Type: integer