报错处理——org.apache.kafka.common.errors.TimeoutException: Timeout expired while fetching topic metadata

具体报错如下：ckpoints to JobManager) (checkpoints: 'hdfs://craw-node212:9000/flink-checkpoints', savepoints: 'null', asynchronous: TRUE, maxStateSize: 5242880)2022-03-13 22:48:00.641 [Process (3/4)] INFOorg

消巴哥

7697人浏览 · 2022-03-13 23:10:16

消巴哥 · 2022-03-13 23:10:16 发布

具体报错如下：连接远程kafka服务失败。

ckpoints to JobManager) (checkpoints: 'hdfs://craw-node212:9000/flink-checkpoints', savepoints: 'null', asynchronous: TRUE, maxStateSize: 5242880)
2022-03-13 22:48:00.641 [Process (3/4)] INFO  org.apache.flink.runtime.taskmanager.Task - Loading JAR files for task Process (3/4) (8ca755fdd1f0138278dc1a2ad31b3a7d) [DEPLOYING].
2022-03-13 22:48:00.642 [Process (3/4)] INFO  org.apache.flink.runtime.taskmanager.Task - Registering task at network: Process (3/4) (8ca755fdd1f0138278dc1a2ad31b3a7d) [DEPLOYING].
2022-03-13 22:48:00.642 [Process (4/4)] INFO  org.apache.flink.runtime.taskmanager.Task - Process (4/4) (e5a99f4f92428d9c1d1f33bf54a454aa) switched from DEPLOYING to RUNNING.
2022-03-13 22:48:00.644 [Process (3/4)] INFO  o.apache.flink.streaming.runtime.tasks.StreamTask - No state backend has been configured, using default (Memory / JobManager) MemoryStateBackend (data in heap memory / checkpoints to JobManager) (checkpoints: 'hdfs://craw-node212:9000/flink-checkpoints', savepoints: 'null', asynchronous: TRUE, maxStateSize: 5242880)
2022-03-13 22:48:00.644 [Process (3/4)] INFO  org.apache.flink.runtime.taskmanager.Task - Process (3/4) (8ca755fdd1f0138278dc1a2ad31b3a7d) switched from DEPLOYING to RUNNING.
2022-03-13 22:48:00.647 [Source: Custom Source (2/2)] INFO  org.apache.kafka.common.utils.AppInfoParser - Kafka version : 2.0.1
2022-03-13 22:48:00.647 [Source: Custom Source (2/2)] INFO  org.apache.kafka.common.utils.AppInfoParser - Kafka commitId : fa14705e51bd2ce5
2022-03-13 22:48:00.653 [Source: Custom Source (1/2)] INFO  org.apache.kafka.common.utils.AppInfoParser - Kafka version : 2.0.1
2022-03-13 22:48:00.654 [Source: Custom Source (1/2)] INFO  org.apache.kafka.common.utils.AppInfoParser - Kafka commitId : fa14705e51bd2ce5
2022-03-13 22:49:00.650 [Source: Custom Source (2/2)] WARN  org.apache.flink.runtime.taskmanager.Task - Source: Custom Source (2/2) (3214cdc7c1e6343f65d3ceb83c74c479) switched from RUNNING to FAILED.
org.apache.kafka.common.errors.TimeoutException: Timeout expired while fetching topic metadata
2022-03-13 22:49:00.650 [Source: Custom Source (2/2)] INFO  org.apache.flink.runtime.taskmanager.Task - Freeing task resources for Source: Custom Source (2/2) (3214cdc7c1e6343f65d3ceb83c74c479).
2022-03-13 22:49:00.652 [flink-akka.actor.default-dispatcher-2] INFO  org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FAILED to JobManager for task Source: Custom Source (2/2) 3214cdc7c1e6343f65d3ceb83c74c479.
2022-03-13 22:49:00.658 [Source: Custom Source (1/2)] WARN  org.apache.flink.runtime.taskmanager.Task - Source: Custom Source (1/2) (cb24bf621522953767b2bcd32c5bb474) switched from RUNNING to FAILED.
org.apache.kafka.common.errors.TimeoutException: Timeout expired while fetching topic metadata
2022-03-13 22:49:00.658 [Source: Custom Source (1/2)] INFO  org.apache.flink.runtime.taskmanager.Task - Freeing task resources for Source: Custom Source (1/2) (cb24bf621522953767b2bcd32c5bb474).

查看页面，消费不到数据：