checkpoint always is IN_PROGRESS #2413

ighack · 2023-08-18T08:12:50Z

ighack
Aug 18, 2023

mysql-cdc 2.2.1
flink 1.17.1

2023-08-18 14:39:42,199 INFO  org.apache.flink.runtime.taskexecutor.TaskManagerRunner      [] - Using configured hostname/address for TaskManager: bigdser5.
2023-08-18 14:39:42,255 INFO  org.apache.flink.runtime.rpc.akka.AkkaRpcServiceUtils        [] - Trying to start actor system, external address bigdser5:0, bind address 0.0.0.0:0.
2023-08-18 14:39:43,050 INFO  akka.event.slf4j.Slf4jLogger                                 [] - Slf4jLogger started
2023-08-18 14:39:43,083 INFO  akka.remote.RemoteActorRefProvider                           [] - Akka Cluster not in use - enabling unsafe features anyway because `akka.remote.use-unsafe-remote-features-outside-cluster` has been enabled.
2023-08-18 14:39:43,084 INFO  akka.remote.Remoting                                         [] - Starting remoting
2023-08-18 14:39:43,300 INFO  akka.remote.Remoting                                         [] - Remoting started; listening on addresses :[akka.tcp://flink@bigdser5:37448]
2023-08-18 14:39:43,434 INFO  org.apache.flink.runtime.rpc.akka.AkkaRpcServiceUtils        [] - Actor system started at akka.tcp://flink@bigdser5:37448
2023-08-18 14:39:43,451 INFO  org.apache.flink.runtime.taskexecutor.TaskManagerRunner      [] - Using working directory: WorkingDirectory(/hadoop/yarn/nm3/usercache/jztwk/appcache/application_1680504434553_0445/tm_container_e90_1680504434553_0445_01_000002)
2023-08-18 14:39:43,461 INFO  org.apache.flink.runtime.metrics.MetricRegistryImpl          [] - No metrics reporter configured, no metrics will be exposed/reported.
2023-08-18 14:39:43,465 INFO  org.apache.flink.runtime.rpc.akka.AkkaRpcServiceUtils        [] - Trying to start actor system, external address bigdser5:0, bind address 0.0.0.0:0.
2023-08-18 14:39:43,480 INFO  akka.event.slf4j.Slf4jLogger                                 [] - Slf4jLogger started
2023-08-18 14:39:43,485 INFO  akka.remote.RemoteActorRefProvider                           [] - Akka Cluster not in use - enabling unsafe features anyway because `akka.remote.use-unsafe-remote-features-outside-cluster` has been enabled.
2023-08-18 14:39:43,485 INFO  akka.remote.Remoting                                         [] - Starting remoting
2023-08-18 14:39:43,494 INFO  akka.remote.Remoting                                         [] - Remoting started; listening on addresses :[akka.tcp://flink-metrics@bigdser5:39071]
2023-08-18 14:39:43,504 INFO  org.apache.flink.runtime.rpc.akka.AkkaRpcServiceUtils        [] - Actor system started at akka.tcp://flink-metrics@bigdser5:39071
2023-08-18 14:39:43,518 INFO  org.apache.flink.runtime.rpc.akka.AkkaRpcService             [] - Starting RPC endpoint for org.apache.flink.runtime.metrics.dump.MetricQueryService at akka://flink-metrics/user/rpc/MetricQueryService_container_e90_1680504434553_0445_01_000002 .
2023-08-18 14:39:43,532 INFO  org.apache.flink.runtime.blob.PermanentBlobCache             [] - Created BLOB cache storage directory /hadoop/yarn/nm3/usercache/jztwk/appcache/application_1680504434553_0445/tm_container_e90_1680504434553_0445_01_000002/blobStorage
2023-08-18 14:39:43,537 INFO  org.apache.flink.runtime.blob.TransientBlobCache             [] - Created BLOB cache storage directory /hadoop/yarn/nm3/usercache/jztwk/appcache/application_1680504434553_0445/tm_container_e90_1680504434553_0445_01_000002/blobStorage
2023-08-18 14:39:43,540 INFO  org.apache.flink.runtime.externalresource.ExternalResourceUtils [] - Enabled external resources: []
2023-08-18 14:39:43,541 INFO  org.apache.flink.runtime.security.token.DelegationTokenReceiverRepository [] - Loading delegation token receivers
2023-08-18 14:39:43,545 INFO  org.apache.flink.runtime.security.token.DelegationTokenReceiverRepository [] - Delegation token receiver hadoopfs loaded and initialized
2023-08-18 14:39:43,545 INFO  org.apache.flink.runtime.security.token.DelegationTokenReceiverRepository [] - Delegation token receiver hbase loaded and initialized
2023-08-18 14:39:43,545 INFO  org.apache.flink.runtime.security.token.DelegationTokenReceiverRepository [] - Delegation token receivers loaded successfully
2023-08-18 14:39:43,545 INFO  org.apache.flink.runtime.taskexecutor.TaskManagerRunner      [] - Starting TaskManager with ResourceID: container_e90_1680504434553_0445_01_000002(bigdser5:8041)
2023-08-18 14:39:43,568 INFO  org.apache.flink.runtime.taskexecutor.TaskManagerServices    [] - Temporary file directory '/hadoop/yarn/nm3/usercache/jztwk/appcache/application_1680504434553_0445': total 499 GB, usable 457 GB (91.58% usable)
2023-08-18 14:39:43,571 INFO  org.apache.flink.runtime.io.disk.iomanager.IOManager         [] - Created a new FileChannelManager for spilling of task related data to disk (joins, sorting, ...). Used directories:
	/hadoop/yarn/nm3/usercache/jztwk/appcache/application_1680504434553_0445/flink-io-272afae2-2aea-4d12-b607-5f9ff77e7aa1
2023-08-18 14:39:43,580 INFO  org.apache.flink.runtime.io.network.netty.NettyConfig        [] - NettyConfig [server address: /0.0.0.0, server port: 0, ssl enabled: false, memory segment size (bytes): 32768, transport type: AUTO, number of server threads: 1 (manual), number of client threads: 1 (manual), server connect backlog: 0 (use Netty's default), client connect timeout (sec): 120, send/receive buffer size (bytes): 0 (use Netty's default)]
2023-08-18 14:39:43,650 INFO  org.apache.flink.runtime.io.network.NettyShuffleServiceFactory [] - Created a new FileChannelManager for storing result partitions of BLOCKING shuffles. Used directories:
	/hadoop/yarn/nm3/usercache/jztwk/appcache/application_1680504434553_0445/flink-netty-shuffle-4aa79664-9a72-4f54-9bcd-d5d65bf0c1c3
2023-08-18 14:39:44,059 INFO  org.apache.flink.runtime.io.network.buffer.NetworkBufferPool [] - Allocated 544 MB for network buffer pool (number of memory segments: 17408, bytes per segment: 32768).
2023-08-18 14:39:44,073 INFO  org.apache.flink.runtime.io.network.NettyShuffleEnvironment  [] - Starting the network environment and its components.
2023-08-18 14:39:44,156 INFO  org.apache.flink.runtime.io.network.netty.NettyClient        [] - Transport type 'auto': using EPOLL.
2023-08-18 14:39:44,157 INFO  org.apache.flink.runtime.io.network.netty.NettyClient        [] - Successful initialization (took 84 ms).
2023-08-18 14:39:44,164 INFO  org.apache.flink.runtime.io.network.netty.NettyServer        [] - Transport type 'auto': using EPOLL.
2023-08-18 14:39:44,205 INFO  org.apache.flink.runtime.io.network.netty.NettyServer        [] - Successful initialization (took 45 ms). Listening on SocketAddress /0:0:0:0:0:0:0:0%0:46050.
2023-08-18 14:39:44,207 INFO  org.apache.flink.runtime.taskexecutor.KvStateService         [] - Starting the kvState service and its components.
2023-08-18 14:39:44,243 INFO  org.apache.flink.runtime.rpc.akka.AkkaRpcService             [] - Starting RPC endpoint for org.apache.flink.runtime.taskexecutor.TaskExecutor at akka://flink/user/rpc/taskmanager_0 .
2023-08-18 14:39:44,265 INFO  org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService [] - Start job leader service.
2023-08-18 14:39:44,267 INFO  org.apache.flink.runtime.filecache.FileCache                 [] - User file cache uses directory /hadoop/yarn/nm3/usercache/jztwk/appcache/application_1680504434553_0445/flink-dist-cache-6c61754e-7de5-4217-bef9-66489d9ddd3a
2023-08-18 14:39:44,270 INFO  org.apache.flink.runtime.taskexecutor.TaskExecutor           [] - Connecting to ResourceManager akka.tcp://flink@bigdser5:36168/user/rpc/resourcemanager_*(00000000000000000000000000000000).
2023-08-18 14:39:44,526 INFO  org.apache.flink.runtime.taskexecutor.TaskExecutor           [] - Resolved ResourceManager address, beginning registration
2023-08-18 14:39:44,618 INFO  org.apache.flink.runtime.taskexecutor.TaskExecutor           [] - Successful registration at resource manager akka.tcp://flink@bigdser5:36168/user/rpc/resourcemanager_* under registration id ce09b24e38543a3a19dab626eae59024.
2023-08-18 14:39:44,618 INFO  org.apache.flink.runtime.taskexecutor.TaskExecutor           [] - Receive initial delegation tokens from resource manager
2023-08-18 14:39:44,621 INFO  org.apache.flink.runtime.security.token.DelegationTokenReceiverRepository [] - New delegation tokens arrived, sending them to receivers
2023-08-18 14:39:44,622 INFO  org.apache.flink.runtime.security.token.hadoop.HadoopFSDelegationTokenReceiver [] - Updating delegation tokens for current user
2023-08-18 14:39:44,622 INFO  org.apache.flink.runtime.security.token.hadoop.HadoopFSDelegationTokenReceiver [] - Token Service:10.3.87.27:8020 Identifier:[0, 21, 106, 122, 116, 119, 107, 47, 104, 97, 100, 111, 111, 112, 64, 74, 79, 73, 78, 46, 67, 79, 77, 0, 0, -118, 1, -118, 7, 94, -47, -122, -118, 1, -118, 43, 107, 85, -122, -114, 81, -38, -114, 3, -14]
2023-08-18 14:39:44,622 INFO  org.apache.flink.runtime.security.token.hadoop.HadoopFSDelegationTokenReceiver [] - Token Service:ha-hdfs:nameservice1 Identifier:[0, 21, 106, 122, 116, 119, 107, 47, 104, 97, 100, 111, 111, 112, 64, 74, 79, 73, 78, 46, 67, 79, 77, 0, 0, -118, 1, -118, 7, 94, -47, 125, -118, 1, -118, 43, 107, 85, 125, -114, 81, -39, -114, 3, -14]
2023-08-18 14:39:44,626 INFO  org.apache.flink.runtime.security.token.hadoop.HadoopFSDelegationTokenReceiver [] - Updated delegation tokens for current user successfully
2023-08-18 14:39:44,626 INFO  org.apache.flink.runtime.security.token.DelegationTokenReceiverRepository [] - Delegation tokens sent to receivers
2023-08-18 14:39:44,711 INFO  org.apache.flink.runtime.taskexecutor.TaskExecutor           [] - Receive slot request 3389e80e5440898744167e8ebb156749 for job e90a77e0b0d22327e9b580d99ea70f96 from resource manager with leader id 00000000000000000000000000000000.
2023-08-18 14:39:44,719 INFO  org.apache.flink.runtime.taskexecutor.TaskExecutor           [] - Allocated slot for 3389e80e5440898744167e8ebb156749.
2023-08-18 14:39:44,721 INFO  org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService [] - Add job e90a77e0b0d22327e9b580d99ea70f96 for job leader monitoring.
2023-08-18 14:39:44,723 INFO  org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService [] - Try to register at job manager akka.tcp://flink@bigdser5:36168/user/rpc/jobmanager_2 with leader id 00000000-0000-0000-0000-000000000000.
2023-08-18 14:39:44,747 INFO  org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService [] - Resolved JobManager address, beginning registration
2023-08-18 14:39:44,771 INFO  org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService [] - Successful registration at job manager akka.tcp://flink@bigdser5:36168/user/rpc/jobmanager_2 for job e90a77e0b0d22327e9b580d99ea70f96.
2023-08-18 14:39:44,773 INFO  org.apache.flink.runtime.taskexecutor.TaskExecutor           [] - Establish JobManager connection for job e90a77e0b0d22327e9b580d99ea70f96.
2023-08-18 14:39:44,776 INFO  org.apache.flink.runtime.taskexecutor.TaskExecutor           [] - Offer reserved slots to the leader of job e90a77e0b0d22327e9b580d99ea70f96.
2023-08-18 14:39:44,814 INFO  org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl [] - Activate slot 3389e80e5440898744167e8ebb156749.
2023-08-18 14:39:44,837 INFO  org.apache.flink.runtime.state.changelog.StateChangelogStorageLoader [] - Creating a changelog storage with name 'memory'.
2023-08-18 14:39:44,849 INFO  org.apache.flink.runtime.state.TaskExecutorChannelStateExecutorFactoryManager [] - Creating the channel state executor factory for job id e90a77e0b0d22327e9b580d99ea70f96
2023-08-18 14:39:44,857 INFO  org.apache.flink.runtime.taskexecutor.TaskExecutor           [] - Received task Source: MDB_GOODS_MAP[1] -> DropUpdateBefore[2] -> Calc[3] -> ConstraintEnforcer[4] -> Sink: LMIS_GOODS_MAP[4] (1/1)#0 (fc70a677e401c864fea1c6886e519e0f_cbc357ccb763df2852fee8c4fc7d55f2_0_0), deploy into slot with allocation id 3389e80e5440898744167e8ebb156749.
2023-08-18 14:39:44,857 INFO  org.apache.flink.runtime.taskmanager.Task                    [] - Source: MDB_GOODS_MAP[1] -> DropUpdateBefore[2] -> Calc[3] -> ConstraintEnforcer[4] -> Sink: LMIS_GOODS_MAP[4] (1/1)#0 (fc70a677e401c864fea1c6886e519e0f_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from CREATED to DEPLOYING.
2023-08-18 14:39:44,862 INFO  org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl [] - Activate slot 3389e80e5440898744167e8ebb156749.
2023-08-18 14:39:44,862 INFO  org.apache.flink.runtime.taskmanager.Task                    [] - Loading JAR files for task Source: MDB_GOODS_MAP[1] -> DropUpdateBefore[2] -> Calc[3] -> ConstraintEnforcer[4] -> Sink: LMIS_GOODS_MAP[4] (1/1)#0 (fc70a677e401c864fea1c6886e519e0f_cbc357ccb763df2852fee8c4fc7d55f2_0_0) [DEPLOYING].
2023-08-18 14:39:44,866 INFO  org.apache.flink.runtime.blob.BlobClient                     [] - Downloading e90a77e0b0d22327e9b580d99ea70f96/p-89e57294e9448310296e0d44065ebc67bb88aa4e-60b1d3098bc9810c5f96b67545be873b from bigdser5/10.3.87.27:44389
2023-08-18 14:39:45,051 INFO  org.apache.flink.streaming.runtime.tasks.StreamTask          [] - Using job/cluster config to configure application-defined state backend: org.apache.flink.runtime.state.hashmap.HashMapStateBackend@b76f232
2023-08-18 14:39:45,052 INFO  org.apache.flink.streaming.runtime.tasks.StreamTask          [] - Using application-defined state backend: org.apache.flink.runtime.state.hashmap.HashMapStateBackend@2eb11ce
2023-08-18 14:39:45,052 INFO  org.apache.flink.runtime.state.StateBackendLoader            [] - State backend loader loads the state backend as HashMapStateBackend
2023-08-18 14:39:45,060 INFO  org.apache.flink.streaming.runtime.tasks.StreamTask          [] - Using job/cluster config to configure application-defined checkpoint storage: org.apache.flink.runtime.state.storage.FileSystemCheckpointStorage@baec5a6c
2023-08-18 14:39:45,060 WARN  org.apache.flink.streaming.runtime.tasks.StreamTask          [] - Config option 'state.checkpoint-storage' is ignored because the checkpoint storage passed via StreamExecutionEnvironment takes precedence.
2023-08-18 14:39:45,819 WARN  org.apache.hadoop.util.NativeCodeLoader                      [] - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2023-08-18 14:39:45,854 INFO  org.apache.flink.runtime.taskmanager.Task                    [] - Source: MDB_GOODS_MAP[1] -> DropUpdateBefore[2] -> Calc[3] -> ConstraintEnforcer[4] -> Sink: LMIS_GOODS_MAP[4] (1/1)#0 (fc70a677e401c864fea1c6886e519e0f_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from DEPLOYING to INITIALIZING.
2023-08-18 14:39:46,607 WARN  org.apache.flink.metrics.MetricGroup                         [] - Name collision: Group already contains a Metric with the name 'currentEmitEventTimeLag'. Metric will not be reported.[bigdser5, taskmanager, container_e90_1680504434553_0445_01_000002, ?????, Source: MDB_GOODS_MAP[1], 0]
2023-08-18 14:39:46,607 WARN  org.apache.flink.metrics.MetricGroup                         [] - Name collision: Group already contains a Metric with the name 'sourceIdleTime'. Metric will not be reported.[bigdser5, taskmanager, container_e90_1680504434553_0445_01_000002, ?????, Source: MDB_GOODS_MAP[1], 0]
2023-08-18 14:39:47,212 INFO  org.apache.flink.runtime.taskmanager.Task                    [] - Source: MDB_GOODS_MAP[1] -> DropUpdateBefore[2] -> Calc[3] -> ConstraintEnforcer[4] -> Sink: LMIS_GOODS_MAP[4] (1/1)#0 (fc70a677e401c864fea1c6886e519e0f_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from INITIALIZING to RUNNING.
2023-08-18 15:12:09,815 INFO  org.apache.flink.runtime.taskmanager.Task                    [] - Attempting to cancel task Source: MDB_GOODS_MAP[1] -> DropUpdateBefore[2] -> Calc[3] -> ConstraintEnforcer[4] -> Sink: LMIS_GOODS_MAP[4] (1/1)#0 (fc70a677e401c864fea1c6886e519e0f_cbc357ccb763df2852fee8c4fc7d55f2_0_0).
2023-08-18 15:12:09,816 INFO  org.apache.flink.runtime.taskmanager.Task                    [] - Source: MDB_GOODS_MAP[1] -> DropUpdateBefore[2] -> Calc[3] -> ConstraintEnforcer[4] -> Sink: LMIS_GOODS_MAP[4] (1/1)#0 (fc70a677e401c864fea1c6886e519e0f_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from RUNNING to CANCELING.
2023-08-18 15:12:09,816 INFO  org.apache.flink.runtime.taskmanager.Task                    [] - Triggering cancellation of task code Source: MDB_GOODS_MAP[1] -> DropUpdateBefore[2] -> Calc[3] -> ConstraintEnforcer[4] -> Sink: LMIS_GOODS_MAP[4] (1/1)#0 (fc70a677e401c864fea1c6886e519e0f_cbc357ccb763df2852fee8c4fc7d55f2_0_0).
2023-08-18 15:12:09,839 INFO  org.apache.flink.connector.base.source.reader.SourceReaderBase [] - Closing Source Reader.
2023-08-18 15:12:09,841 INFO  org.apache.flink.runtime.taskmanager.Task                    [] - Source: MDB_GOODS_MAP[1] -> DropUpdateBefore[2] -> Calc[3] -> ConstraintEnforcer[4] -> Sink: LMIS_GOODS_MAP[4] (1/1)#0 (fc70a677e401c864fea1c6886e519e0f_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from CANCELING to CANCELED.
2023-08-18 15:12:09,842 INFO  org.apache.flink.runtime.taskmanager.Task                    [] - Freeing task resources for Source: MDB_GOODS_MAP[1] -> DropUpdateBefore[2] -> Calc[3] -> ConstraintEnforcer[4] -> Sink: LMIS_GOODS_MAP[4] (1/1)#0 (fc70a677e401c864fea1c6886e519e0f_cbc357ccb763df2852fee8c4fc7d55f2_0_0).
2023-08-18 15:12:09,843 INFO  org.apache.flink.runtime.taskexecutor.TaskExecutor           [] - Un-registering task and sending final execution state CANCELED to JobManager for task Source: MDB_GOODS_MAP[1] -> DropUpdateBefore[2] -> Calc[3] -> ConstraintEnforcer[4] -> Sink: LMIS_GOODS_MAP[4] (1/1)#0 fc70a677e401c864fea1c6886e519e0f_cbc357ccb763df2852fee8c4fc7d55f2_0_0.
2023-08-18 15:12:10,883 INFO  org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl [] - Activate slot 3389e80e5440898744167e8ebb156749.
2023-08-18 15:12:10,885 INFO  org.apache.flink.runtime.taskexecutor.TaskExecutor           [] - Received task Source: MDB_GOODS_MAP[1] -> DropUpdateBefore[2] -> Calc[3] -> ConstraintEnforcer[4] -> Sink: LMIS_GOODS_MAP[4] (1/1)#1 (fc70a677e401c864fea1c6886e519e0f_cbc357ccb763df2852fee8c4fc7d55f2_0_1), deploy into slot with allocation id 3389e80e5440898744167e8ebb156749.
2023-08-18 15:12:10,886 INFO  org.apache.flink.runtime.taskmanager.Task                    [] - Source: MDB_GOODS_MAP[1] -> DropUpdateBefore[2] -> Calc[3] -> ConstraintEnforcer[4] -> Sink: LMIS_GOODS_MAP[4] (1/1)#1 (fc70a677e401c864fea1c6886e519e0f_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from CREATED to DEPLOYING.
2023-08-18 15:12:10,886 INFO  org.apache.flink.runtime.taskmanager.Task                    [] - Loading JAR files for task Source: MDB_GOODS_MAP[1] -> DropUpdateBefore[2] -> Calc[3] -> ConstraintEnforcer[4] -> Sink: LMIS_GOODS_MAP[4] (1/1)#1 (fc70a677e401c864fea1c6886e519e0f_cbc357ccb763df2852fee8c4fc7d55f2_0_1) [DEPLOYING].
2023-08-18 15:12:10,887 INFO  org.apache.flink.streaming.runtime.tasks.StreamTask          [] - Using job/cluster config to configure application-defined state backend: org.apache.flink.runtime.state.hashmap.HashMapStateBackend@5131c2fa
2023-08-18 15:12:10,888 INFO  org.apache.flink.streaming.runtime.tasks.StreamTask          [] - Using application-defined state backend: org.apache.flink.runtime.state.hashmap.HashMapStateBackend@3a475d8e
2023-08-18 15:12:10,888 INFO  org.apache.flink.runtime.state.StateBackendLoader            [] - State backend loader loads the state backend as HashMapStateBackend
2023-08-18 15:12:10,888 INFO  org.apache.flink.streaming.runtime.tasks.StreamTask          [] - Using job/cluster config to configure application-defined checkpoint storage: org.apache.flink.runtime.state.storage.FileSystemCheckpointStorage@baec5a6c
2023-08-18 15:12:10,888 WARN  org.apache.flink.streaming.runtime.tasks.StreamTask          [] - Config option 'state.checkpoint-storage' is ignored because the checkpoint storage passed via StreamExecutionEnvironment takes precedence.
2023-08-18 15:12:10,889 INFO  org.apache.flink.runtime.taskmanager.Task                    [] - Source: MDB_GOODS_MAP[1] -> DropUpdateBefore[2] -> Calc[3] -> ConstraintEnforcer[4] -> Sink: LMIS_GOODS_MAP[4] (1/1)#1 (fc70a677e401c864fea1c6886e519e0f_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from DEPLOYING to INITIALIZING.
2023-08-18 15:12:10,951 WARN  org.apache.flink.metrics.MetricGroup                         [] - Name collision: Group already contains a Metric with the name 'currentEmitEventTimeLag'. Metric will not be reported.[bigdser5, taskmanager, container_e90_1680504434553_0445_01_000002, ?????, Source: MDB_GOODS_MAP[1], 0]
2023-08-18 15:12:10,951 WARN  org.apache.flink.metrics.MetricGroup                         [] - Name collision: Group already contains a Metric with the name 'sourceIdleTime'. Metric will not be reported.[bigdser5, taskmanager, container_e90_1680504434553_0445_01_000002, ?????, Source: MDB_GOODS_MAP[1], 0]
2023-08-18 15:12:11,138 INFO  org.apache.flink.runtime.taskmanager.Task                    [] - Source: MDB_GOODS_MAP[1] -> DropUpdateBefore[2] -> Calc[3] -> ConstraintEnforcer[4] -> Sink: LMIS_GOODS_MAP[4] (1/1)#1 (fc70a677e401c864fea1c6886e519e0f_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from INITIALIZING to RUNNING.
2023-08-18 15:33:47,822 INFO  org.apache.flink.runtime.taskmanager.Task                    [] - Attempting to cancel task Source: MDB_GOODS_MAP[1] -> DropUpdateBefore[2] -> Calc[3] -> ConstraintEnforcer[4] -> Sink: LMIS_GOODS_MAP[4] (1/1)#1 (fc70a677e401c864fea1c6886e519e0f_cbc357ccb763df2852fee8c4fc7d55f2_0_1).
2023-08-18 15:33:47,823 INFO  org.apache.flink.runtime.taskmanager.Task                    [] - Source: MDB_GOODS_MAP[1] -> DropUpdateBefore[2] -> Calc[3] -> ConstraintEnforcer[4] -> Sink: LMIS_GOODS_MAP[4] (1/1)#1 (fc70a677e401c864fea1c6886e519e0f_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from RUNNING to CANCELING.
2023-08-18 15:33:47,823 INFO  org.apache.flink.runtime.taskmanager.Task                    [] - Triggering cancellation of task code Source: MDB_GOODS_MAP[1] -> DropUpdateBefore[2] -> Calc[3] -> ConstraintEnforcer[4] -> Sink: LMIS_GOODS_MAP[4] (1/1)#1 (fc70a677e401c864fea1c6886e519e0f_cbc357ccb763df2852fee8c4fc7d55f2_0_1).
2023-08-18 15:33:47,849 INFO  org.apache.flink.connector.base.source.reader.SourceReaderBase [] - Closing Source Reader.
2023-08-18 15:33:47,850 INFO  org.apache.flink.runtime.taskmanager.Task                    [] - Source: MDB_GOODS_MAP[1] -> DropUpdateBefore[2] -> Calc[3] -> ConstraintEnforcer[4] -> Sink: LMIS_GOODS_MAP[4] (1/1)#1 (fc70a677e401c864fea1c6886e519e0f_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from CANCELING to CANCELED.
2023-08-18 15:33:47,850 INFO  org.apache.flink.runtime.taskmanager.Task                    [] - Freeing task resources for Source: MDB_GOODS_MAP[1] -> DropUpdateBefore[2] -> Calc[3] -> ConstraintEnforcer[4] -> Sink: LMIS_GOODS_MAP[4] (1/1)#1 (fc70a677e401c864fea1c6886e519e0f_cbc357ccb763df2852fee8c4fc7d55f2_0_1).
2023-08-18 15:33:47,851 INFO  org.apache.flink.runtime.taskexecutor.TaskExecutor           [] - Un-registering task and sending final execution state CANCELED to JobManager for task Source: MDB_GOODS_MAP[1] -> DropUpdateBefore[2] -> Calc[3] -> ConstraintEnforcer[4] -> Sink: LMIS_GOODS_MAP[4] (1/1)#1 fc70a677e401c864fea1c6886e519e0f_cbc357ccb763df2852fee8c4fc7d55f2_0_1.
2023-08-18 15:33:48,829 INFO  org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl [] - Activate slot 3389e80e5440898744167e8ebb156749.
2023-08-18 15:33:48,831 INFO  org.apache.flink.runtime.taskexecutor.TaskExecutor           [] - Received task Source: MDB_GOODS_MAP[1] -> DropUpdateBefore[2] -> Calc[3] -> ConstraintEnforcer[4] -> Sink: LMIS_GOODS_MAP[4] (1/1)#2 (fc70a677e401c864fea1c6886e519e0f_cbc357ccb763df2852fee8c4fc7d55f2_0_2), deploy into slot with allocation id 3389e80e5440898744167e8ebb156749.
2023-08-18 15:33:48,831 INFO  org.apache.flink.runtime.taskmanager.Task                    [] - Source: MDB_GOODS_MAP[1] -> DropUpdateBefore[2] -> Calc[3] -> ConstraintEnforcer[4] -> Sink: LMIS_GOODS_MAP[4] (1/1)#2 (fc70a677e401c864fea1c6886e519e0f_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from CREATED to DEPLOYING.
2023-08-18 15:33:48,832 INFO  org.apache.flink.runtime.taskmanager.Task                    [] - Loading JAR files for task Source: MDB_GOODS_MAP[1] -> DropUpdateBefore[2] -> Calc[3] -> ConstraintEnforcer[4] -> Sink: LMIS_GOODS_MAP[4] (1/1)#2 (fc70a677e401c864fea1c6886e519e0f_cbc357ccb763df2852fee8c4fc7d55f2_0_2) [DEPLOYING].
2023-08-18 15:33:48,832 INFO  org.apache.flink.streaming.runtime.tasks.StreamTask          [] - Using job/cluster config to configure application-defined state backend: org.apache.flink.runtime.state.hashmap.HashMapStateBackend@23de8326
2023-08-18 15:33:48,832 INFO  org.apache.flink.streaming.runtime.tasks.StreamTask          [] - Using application-defined state backend: org.apache.flink.runtime.state.hashmap.HashMapStateBackend@d0e62e3
2023-08-18 15:33:48,833 INFO  org.apache.flink.runtime.state.StateBackendLoader            [] - State backend loader loads the state backend as HashMapStateBackend
2023-08-18 15:33:48,833 INFO  org.apache.flink.streaming.runtime.tasks.StreamTask          [] - Using job/cluster config to configure application-defined checkpoint storage: org.apache.flink.runtime.state.storage.FileSystemCheckpointStorage@baec5a6c
2023-08-18 15:33:48,833 WARN  org.apache.flink.streaming.runtime.tasks.StreamTask          [] - Config option 'state.checkpoint-storage' is ignored because the checkpoint storage passed via StreamExecutionEnvironment takes precedence.
2023-08-18 15:33:48,833 INFO  org.apache.flink.runtime.taskmanager.Task                    [] - Source: MDB_GOODS_MAP[1] -> DropUpdateBefore[2] -> Calc[3] -> ConstraintEnforcer[4] -> Sink: LMIS_GOODS_MAP[4] (1/1)#2 (fc70a677e401c864fea1c6886e519e0f_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from DEPLOYING to INITIALIZING.
2023-08-18 15:33:48,901 WARN  org.apache.flink.metrics.MetricGroup                         [] - Name collision: Group already contains a Metric with the name 'currentEmitEventTimeLag'. Metric will not be reported.[bigdser5, taskmanager, container_e90_1680504434553_0445_01_000002, ?????, Source: MDB_GOODS_MAP[1], 0]
2023-08-18 15:33:48,901 WARN  org.apache.flink.metrics.MetricGroup                         [] - Name collision: Group already contains a Metric with the name 'sourceIdleTime'. Metric will not be reported.[bigdser5, taskmanager, container_e90_1680504434553_0445_01_000002, ?????, Source: MDB_GOODS_MAP[1], 0]
2023-08-18 15:33:49,138 INFO  org.apache.flink.runtime.taskmanager.Task                    [] - Source: MDB_GOODS_MAP[1] -> DropUpdateBefore[2] -> Calc[3] -> ConstraintEnforcer[4] -> Sink: LMIS_GOODS_MAP[4] (1/1)#2 (fc70a677e401c864fea1c6886e519e0f_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from INITIALIZING to RUNNING.
2023-08-18 15:54:13,660 INFO  org.apache.flink.runtime.taskmanager.Task                    [] - Attempting to cancel task Source: MDB_GOODS_MAP[1] -> DropUpdateBefore[2] -> Calc[3] -> ConstraintEnforcer[4] -> Sink: LMIS_GOODS_MAP[4] (1/1)#2 (fc70a677e401c864fea1c6886e519e0f_cbc357ccb763df2852fee8c4fc7d55f2_0_2).
2023-08-18 15:54:13,661 INFO  org.apache.flink.runtime.taskmanager.Task                    [] - Source: MDB_GOODS_MAP[1] -> DropUpdateBefore[2] -> Calc[3] -> ConstraintEnforcer[4] -> Sink: LMIS_GOODS_MAP[4] (1/1)#2 (fc70a677e401c864fea1c6886e519e0f_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from RUNNING to CANCELING.
2023-08-18 15:54:13,661 INFO  org.apache.flink.runtime.taskmanager.Task                    [] - Triggering cancellation of task code Source: MDB_GOODS_MAP[1] -> DropUpdateBefore[2] -> Calc[3] -> ConstraintEnforcer[4] -> Sink: LMIS_GOODS_MAP[4] (1/1)#2 (fc70a677e401c864fea1c6886e519e0f_cbc357ccb763df2852fee8c4fc7d55f2_0_2).
2023-08-18 15:54:13,681 INFO  org.apache.flink.connector.base.source.reader.SourceReaderBase [] - Closing Source Reader.
2023-08-18 15:54:13,681 INFO  org.apache.flink.runtime.taskmanager.Task                    [] - Source: MDB_GOODS_MAP[1] -> DropUpdateBefore[2] -> Calc[3] -> ConstraintEnforcer[4] -> Sink: LMIS_GOODS_MAP[4] (1/1)#2 (fc70a677e401c864fea1c6886e519e0f_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from CANCELING to CANCELED.
2023-08-18 15:54:13,681 INFO  org.apache.flink.runtime.taskmanager.Task                    [] - Freeing task resources for Source: MDB_GOODS_MAP[1] -> DropUpdateBefore[2] -> Calc[3] -> ConstraintEnforcer[4] -> Sink: LMIS_GOODS_MAP[4] (1/1)#2 (fc70a677e401c864fea1c6886e519e0f_cbc357ccb763df2852fee8c4fc7d55f2_0_2).
2023-08-18 15:54:13,683 INFO  org.apache.flink.runtime.taskexecutor.TaskExecutor           [] - Un-registering task and sending final execution state CANCELED to JobManager for task Source: MDB_GOODS_MAP[1] -> DropUpdateBefore[2] -> Calc[3] -> ConstraintEnforcer[4] -> Sink: LMIS_GOODS_MAP[4] (1/1)#2 fc70a677e401c864fea1c6886e519e0f_cbc357ccb763df2852fee8c4fc7d55f2_0_2.
2023-08-18 15:54:14,666 INFO  org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl [] - Activate slot 3389e80e5440898744167e8ebb156749.
2023-08-18 15:54:14,667 INFO  org.apache.flink.runtime.taskexecutor.TaskExecutor           [] - Received task Source: MDB_GOODS_MAP[1] -> DropUpdateBefore[2] -> Calc[3] -> ConstraintEnforcer[4] -> Sink: LMIS_GOODS_MAP[4] (1/1)#3 (fc70a677e401c864fea1c6886e519e0f_cbc357ccb763df2852fee8c4fc7d55f2_0_3), deploy into slot with allocation id 3389e80e5440898744167e8ebb156749.
2023-08-18 15:54:14,668 INFO  org.apache.flink.runtime.taskmanager.Task                    [] - Source: MDB_GOODS_MAP[1] -> DropUpdateBefore[2] -> Calc[3] -> ConstraintEnforcer[4] -> Sink: LMIS_GOODS_MAP[4] (1/1)#3 (fc70a677e401c864fea1c6886e519e0f_cbc357ccb763df2852fee8c4fc7d55f2_0_3) switched from CREATED to DEPLOYING.
2023-08-18 15:54:14,668 INFO  org.apache.flink.runtime.taskmanager.Task                    [] - Loading JAR files for task Source: MDB_GOODS_MAP[1] -> DropUpdateBefore[2] -> Calc[3] -> ConstraintEnforcer[4] -> Sink: LMIS_GOODS_MAP[4] (1/1)#3 (fc70a677e401c864fea1c6886e519e0f_cbc357ccb763df2852fee8c4fc7d55f2_0_3) [DEPLOYING].
2023-08-18 15:54:14,669 INFO  org.apache.flink.streaming.runtime.tasks.StreamTask          [] - Using job/cluster config to configure application-defined state backend: org.apache.flink.runtime.state.hashmap.HashMapStateBackend@705ad88c
2023-08-18 15:54:14,669 INFO  org.apache.flink.streaming.runtime.tasks.StreamTask          [] - Using application-defined state backend: org.apache.flink.runtime.state.hashmap.HashMapStateBackend@27dca6a
2023-08-18 15:54:14,669 INFO  org.apache.flink.runtime.state.StateBackendLoader            [] - State backend loader loads the state backend as HashMapStateBackend
2023-08-18 15:54:14,669 INFO  org.apache.flink.streaming.runtime.tasks.StreamTask          [] - Using job/cluster config to configure application-defined checkpoint storage: org.apache.flink.runtime.state.storage.FileSystemCheckpointStorage@baec5a6c
2023-08-18 15:54:14,669 WARN  org.apache.flink.streaming.runtime.tasks.StreamTask          [] - Config option 'state.checkpoint-storage' is ignored because the checkpoint storage passed via StreamExecutionEnvironment takes precedence.
2023-08-18 15:54:14,670 INFO  org.apache.flink.runtime.taskmanager.Task                    [] - Source: MDB_GOODS_MAP[1] -> DropUpdateBefore[2] -> Calc[3] -> ConstraintEnforcer[4] -> Sink: LMIS_GOODS_MAP[4] (1/1)#3 (fc70a677e401c864fea1c6886e519e0f_cbc357ccb763df2852fee8c4fc7d55f2_0_3) switched from DEPLOYING to INITIALIZING.
2023-08-18 15:54:14,713 WARN  org.apache.flink.metrics.MetricGroup                         [] - Name collision: Group already contains a Metric with the name 'currentEmitEventTimeLag'. Metric will not be reported.[bigdser5, taskmanager, container_e90_1680504434553_0445_01_000002, ?????, Source: MDB_GOODS_MAP[1], 0]
2023-08-18 15:54:14,714 WARN  org.apache.flink.metrics.MetricGroup                         [] - Name collision: Group already contains a Metric with the name 'sourceIdleTime'. Metric will not be reported.[bigdser5, taskmanager, container_e90_1680504434553_0445_01_000002, ?????, Source: MDB_GOODS_MAP[1], 0]
2023-08-18 15:54:14,893 INFO  org.apache.flink.runtime.taskmanager.Task                    [] - Source: MDB_GOODS_MAP[1] -> DropUpdateBefore[2] -> Calc[3] -> ConstraintEnforcer[4] -> Sink: LMIS_GOODS_MAP[4] (1/1)#3 (fc70a677e401c864fea1c6886e519e0f_cbc357ccb763df2852fee8c4fc7d55f2_0_3) switched from INITIALIZING to RUNNING.

wqlsdb · 2023-09-27T02:36:11Z

wqlsdb
Sep 27, 2023

数据量多大？是inital模式吗？有启用state吗？日志中似乎是使用了HashMapStateBackend，你的这个binlog似乎没有读取到，还需要更多的日志

0 replies

ighack · 2023-10-10T01:53:41Z

ighack
Oct 10, 2023
Author

我们现在也认为是没读到binlog 但我的binlog就在那里啊。不可能读不到

0 replies

gtk96 · 2023-10-11T06:09:22Z

gtk96
Oct 11, 2023

我们现在也认为是没读到binlog 但我的binlog就在那里啊。不可能读不到

升级到 2.4.1 试试看

0 replies

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

checkpoint always is IN_PROGRESS #2413

Uh oh!

{{title}}

Uh oh!

Replies: 3 comments

Uh oh!

{{title}}

Uh oh!

Uh oh!

{{title}}

Uh oh!

Uh oh!

{{title}}

Uh oh!

Select a reply

Uh oh!

checkpoint always is IN_PROGRESS #2413

Uh oh!

ighack Aug 18, 2023

Replies: 3 comments

Uh oh!

wqlsdb Sep 27, 2023

Uh oh!

ighack Oct 10, 2023 Author

Uh oh!

gtk96 Oct 11, 2023

ighack
Aug 18, 2023

wqlsdb
Sep 27, 2023

ighack
Oct 10, 2023
Author

gtk96
Oct 11, 2023