Skip to content

无法启动chunjun #1791

Open
Open

Description

@ysq5202121

Search before asking

  • I had searched in the issues and found no similar question.

  • I had googled my question but i didn't get any help.

  • I had read the documentation: ChunJun doc but it didn't help me.

Description

2023-08-14 19:24:45,210 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - --------------------------------------------------------------------------------
2023-08-14 19:24:45,216 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Starting YarnSessionClusterEntrypoint (Version: 1.16.1, Scala: 2.12, Rev:DeadD0d0, Date:1970-01-01T01:00:00+01:00)
2023-08-14 19:24:45,217 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - OS current user: hadoop
2023-08-14 19:24:45,537 WARN org.apache.hadoop.util.NativeCodeLoader [] - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2023-08-14 19:24:45,654 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Current Hadoop/Kerberos user: root
2023-08-14 19:24:45,654 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - JVM: OpenJDK 64-Bit Server VM - Red Hat, Inc. - 1.8/25.372-b07
2023-08-14 19:24:45,654 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Arch: amd64
2023-08-14 19:24:45,654 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Maximum heap size: 429 MiBytes
2023-08-14 19:24:45,654 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - JAVA_HOME: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.372.b07-1.el7_9.x86_64/jre
2023-08-14 19:24:45,655 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Hadoop version: 2.7.5
2023-08-14 19:24:45,656 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - JVM Options:
2023-08-14 19:24:45,656 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -Xmx469762048
2023-08-14 19:24:45,656 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -Xms469762048
2023-08-14 19:24:45,660 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -XX:MaxMetaspaceSize=268435456
2023-08-14 19:24:45,660 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -Dlog.file=/opt/hadoop-3.3.6/logs/userlogs/application_1599911135538_0162/container_1599911135538_0162_01_000001/jobmanager.log
2023-08-14 19:24:45,660 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -Dlog4j.configuration=file:log4j.properties
2023-08-14 19:24:45,660 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -Dlog4j.configurationFile=file:log4j.properties
2023-08-14 19:24:45,660 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Program Arguments:
2023-08-14 19:24:45,662 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -D
2023-08-14 19:24:45,662 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - jobmanager.memory.off-heap.size=134217728b
2023-08-14 19:24:45,662 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -D
2023-08-14 19:24:45,662 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - jobmanager.memory.jvm-overhead.min=201326592b
2023-08-14 19:24:45,662 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -D
2023-08-14 19:24:45,662 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - jobmanager.memory.jvm-metaspace.size=268435456b
2023-08-14 19:24:45,662 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -D
2023-08-14 19:24:45,663 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - jobmanager.memory.heap.size=469762048b
2023-08-14 19:24:45,663 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -D
2023-08-14 19:24:45,663 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - jobmanager.memory.jvm-overhead.max=201326592b
2023-08-14 19:24:45,663 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Classpath: :chunjun-dist/chunjun-core.jar:chunjun-dist/connector/arctic/chunjun-connector-arctic.jar:chunjun-dist/connector/binlog/chunjun-connector-binlog.jar:chunjun-dist/connector/cassandra/chunjun-connector-cassandra.jar:chunjun-dist/connector/clickhouse/chunjun-connector-clickhouse.jar:chunjun-dist/connector/db2/chunjun-connector-db2.jar:chunjun-dist/connector/dm/chunjun-connector-dm.jar:chunjun-dist/connector/doris/chunjun-connector-doris.jar:chunjun-dist/connector/elasticsearch6/chunjun-connector-elasticsearch6.jar:chunjun-dist/connector/elasticsearch7/chunjun-connector-elasticsearch7.jar:chunjun-dist/connector/emqx/chunjun-connector-emqx.jar:chunjun-dist/connector/file/chunjun-connector-file.jar:chunjun-dist/connector/ftp/chunjun-connector-ftp.jar:chunjun-dist/connector/greenplum/chunjun-connector-greenplum.jar:chunjun-dist/connector/hbase14/chunjun-connector-hbase-1.4.jar:chunjun-dist/connector/hbase2/chunjun-connector-hbase2.jar:chunjun-dist/connector/hdfs/chunjun-connector-hdfs.jar:chunjun-dist/connector/hive/chunjun-connector-hive.jar:chunjun-dist/connector/hive3/chunjun-connector-hive3.jar:chunjun-dist/connector/http/chunjun-connector-http.jar:chunjun-dist/connector/iceberg/chunjun-connector-iceberg.jar:chunjun-dist/connector/influxdb/chunjun-connector-influxdb.jar:chunjun-dist/connector/kafka/chunjun-connector-kafka.jar:chunjun-dist/connector/kingbase/chunjun-connector-kingbase.jar:chunjun-dist/connector/kudu/chunjun-connector-kudu.jar:chunjun-dist/connector/mongodb/chunjun-connector-mongodb.jar:chunjun-dist/connector/mysql/chunjun-connector-mysql.jar:chunjun-dist/connector/mysqlcdc/chunjun-connector-mysqlcdc.jar:chunjun-dist/connector/mysqld/chunjun-connector-mysqld.jar:chunjun-dist/connector/nebula/chunjun-connector-nebula.jar:chunjun-dist/connector/oceanbase/chunjun-connector-oceanbase.jar:chunjun-dist/connector/oceanbasecdc/chunjun-connector-oceanbasecdc.jar:chunjun-dist/connector/oracle/chunjun-connector-oracle.jar:chunjun-dist/connector/oraclelogminer/chunjun-connector-oraclelogminer.jar:chunjun-dist/connector/postgresql/chunjun-connector-postgresql.jar:chunjun-dist/connector/rabbitmq/chunjun-connector-rabbitmq.jar:chunjun-dist/connector/redis/chunjun-connector-redis.jar:chunjun-dist/connector/rocketmq/chunjun-connector-rocketmq.jar:chunjun-dist/connector/s3/chunjun-connector-s3.jar:chunjun-dist/connector/saphana/chunjun-connector-saphana.jar:chunjun-dist/connector/selectdb-cloud/chunjun-connector-selectdb-cloud.jar:chunjun-dist/connector/socket/chunjun-connector-socket.jar:chunjun-dist/connector/solr/chunjun-connector-solr.jar:chunjun-dist/connector/sqlserver/chunjun-connector-sqlserver.jar:chunjun-dist/connector/sqlservercdc/chunjun-connector-sqlservercdc.jar:chunjun-dist/connector/starrocks/chunjun-connector-starrocks.jar:chunjun-dist/connector/stream/chunjun-connector-stream.jar:chunjun-dist/connector/sybase/chunjun-connector-sybase.jar:chunjun-dist/connector/vertica11/chunjun-connector-vertica11.jar:chunjun-dist/ddl-plugins/mysql/chunjun-ddl-mysql.jar:chunjun-dist/ddl-plugins/oracle/chunjun-ddl-oracle.jar:chunjun-dist/dirty-data-collector/log/chunjun-dirty-log.jar:chunjun-dist/dirty-data-collector/mysql/chunjun-dirty-mysql.jar:chunjun-dist/docker-build:chunjun-dist/metrics/mysql/chunjun-metrics-mysql.jar:chunjun-dist/metrics/prometheus/chunjun-metrics-prometheus.jar:chunjun-dist/restore-plugins/mysql/chunjun-restore-mysql.jar:lib/commons-cli-1.5.0.jar:lib/dlink-catalog-mysql-1.16-0.7.3.jar:lib/flink-cep-1.16.2.jar:lib/flink-connector-clickhouse-1.16.0-SNAPSHOT.jar:lib/flink-connector-files-1.16.2.jar:lib/flink-csv-1.16.2.jar:lib/flink-json-1.16.2.jar:lib/flink-scala_2.12-1.16.2.jar:lib/flink-shaded-hadoop-3-uber-3.1.1.7.2.9.0-173-9.0.jar:lib/flink-shaded-zookeeper-3.5.9.jar:lib/flink-sql-connector-hive-3.1.2_2.12-1.16.0.jar:lib/flink-sql-connector-sqlserver-cdc-2.5-SNAPSHOT.jar:lib/flink-table-api-java-uber-1.16.2.jar:lib/flink-table-planner-loader-1.16.2.jar:lib/flink-table-runtime-1.16.2.jar:lib/log4j-1.2-api-2.17.1.jar:lib/log4j-api-2.17.1.jar:lib/log4j-core-2.17.1.jar:lib/log4j-slf4j-impl-2.17.1.jar:flink-dist-1.16.2.jar:flink-conf.yaml::/opt/hadoop-3.3.6/etc/hadoop:/opt/hadoop-3.3.6/share/hadoop/common/hadoop-nfs-3.3.6.jar:/opt/hadoop-3.3.6/share/hadoop/common/hadoop-common-3.3.6-tests.jar:/opt/hadoop-3.3.6/share/hadoop/common/hadoop-registry-3.3.6.jar:/opt/hadoop-3.3.6/share/hadoop/common/hadoop-kms-3.3.6.jar:/opt/hadoop-3.3.6/share/hadoop/common/hadoop-common-3.3.6.jar:/opt/hadoop-3.3.6/share/hadoop/common/lib/netty-resolver-dns-native-macos-4.1.89.Final-osx-aarch_64.jar:/opt/hadoop-3.3.6/share/hadoop/common/lib/netty-codec-socks-4.1.89.Final.jar:/opt/hadoop-3.3.6/share/hadoop/common/lib/kerb-identity-1.0.1.jar:/opt/hadoop-3.3.6/share/hadoop/common/lib/kerby-asn1-1.0.1.jar:/opt/hadoop-3.3.6/share/hadoop/common/lib/commons-math3-3.1.1.jar:/opt/hadoop-3.3.6/share/hadoop/common/lib/jetty-xml-9.4.51.v20230217.jar:/opt/hadoop-3.3.6/share/hadoop/common/lib/kerb-crypto-1.0.1.jar:/opt/hadoop-3.3.6/share/hadoop/common/lib/netty-codec-xml-4.1.89.Final.jar:/opt/hadoop-3.3.6/share/hadoop/common/lib/netty-transport-sctp-4.1.89.Final.jar:/opt/hadoop-3.3.6/share/hadoop/common/lib/commons-collections-3.2.2.jar:/opt/hadoop-3.3.6/share/hadoop/common/lib/jsp-api-2.1.jar:/opt/hadoop-3.3.6/share/hadoop/common/lib/commons-codec-1.15.jar:/opt/hadoop-3.3.6/share/hadoop/common/lib/jackson-mapper-asl-1.9.13.jar:/opt/hadoop-3.3.6/share/hadoop/common/lib/reload4j-1.2.22.jar:/opt/hadoop-3.3.6/share/hadoop/common/lib/jersey-server-1.19.4.jar:/opt/hadoop-3.3.6/share/hadoop/common/lib/jsch-0.1.55.jar:/opt/hadoop-3.3.6/share/hadoop/common/lib/kerby-util-1.0.1.jar:/opt/hadoop-3.3.6/share/hadoop/common/lib/commons-io-2.8.0.jar:/opt/hadoop-3.3.6/share/hadoop/common/lib/token-provider-1.0.1.jar:/opt/hadoop-3.3.6/share/hadoop/common/lib/stax2-api-4.2.1.jar:/opt/hadoop-3.3.6/share/hadoop/common/lib/netty-codec-dns-4.1.89.Final.jar:/opt/hadoop-3.3.6/share/hadoop/common/lib/avro-1.7.7.jar:/opt/hadoop-3.3.6/share/hadoop/common/lib/commons-text-1.10.0.jar:/opt/hadoop-3.3.6/share/hadoop/common/lib/netty-transport-native-kqueue-4.1.89.Final-osx-aarch_64.jar:/opt/hadoop-3.3.6/share/hadoop/common/lib/hadoop-auth-3.3.6.jar:/opt/hadoop-3.3.6/share/hadoop/common/lib/kerby-config-1.0.1.jar:/opt/hadoop-3.3.6/share/hadoop/common/lib/j2objc-annotations-1.1.jar:/opt/hadoop-3.3.6/share/hadoop/common/lib/commons-lang3-3.12.0.jar:/opt/hadoop-3.3.6/share/hadoop/common/lib/jetty-server-9.4.51.v20230217.jar:/opt/hadoop-3.3.6/share/hadoop/common/lib/jersey-servlet-1.19.4.jar:/opt/hadoop-3.3.6/share/hadoop/common/lib/slf4j-reload4j-1.7.36.jar:/opt/hadoop-3.3.6/share/hadoop/common/lib/kerb-common-1.0.1.jar:/opt/hadoop-3.3.6/share/hadoop/common/lib/hadoop-shaded-protobuf_3_7-1.1.1.jar:/opt/hadoop-3.3.6/share/hadoop/common/lib/guava-27.0-jre.jar:/opt/hadoop-3.3.6/share/hadoop/common/lib/netty-transport-rxtx-4.1.89.Final.jar:/opt/hadoop-3.3.6/share/hadoop/common/lib/jersey-core-1.19.4.jar:/opt/hadoop-3.3.6/share/hadoop/common/lib/commons-logging-1.1.3.jar:/opt/hadoop-3.3.6/share/hadoop/common/lib/curator-recipes-5.2.0.jar:/opt/hadoop-3.3.6/share/hadoop/common/lib/netty-resolver-dns-classes-macos-4.1.89.Final.jar:/opt/hadoop-3.3.6/share/hadoop/common/lib/netty-handler-ssl-ocsp-4.1.89.Final.jar:/opt/hadoop-3.3.6/share/hadoop/common/lib/netty-transport-native-epoll-4.1.89.Final-linux-aarch_64.jar:/opt/hadoop-3.3.6/share/hadoop/common/lib/curator-framework-5.2.0.jar:/opt/hadoop-3.3.6/share/hadoop/common/lib/jul-to-slf4j-1.7.36.jar:/opt/hadoop-3.3.6/share/hadoop/common/lib/netty-codec-http-4.1.89.Final.jar:/opt/hadoop-3.3.6/share/hadoop/common/lib/netty-codec-http2-4.1.89.Final.jar:/opt/hadoop-3.3.6/share/hadoop/common/lib/netty-codec-haproxy-4.1.89.Final.jar:/opt/hadoop-3.3.6/share/hadoop/common/lib/netty-transport-4.1.89.Final.jar:/opt/hadoop-3.3.6/share/hadoop/common/lib/checker-qual-2.5.2.jar:/opt/hadoop-3.3.6/share/hadoop/common/lib/jsr305-3.0.2.jar:/opt/hadoop-3.3.6/share/hadoop/common/lib/kerb-server-1.0.1.jar:/opt/hadoop-3.3.6/share/hadoop/common/lib/jetty-util-ajax-9.4.51.v20230217.jar:/opt/hadoop-3.3.6/share/hadoop/common/lib/javax.servlet-api-3.1.0.jar:/opt/hadoop-3.3.6/share/hadoop/common/lib/jaxb-impl-2.2.3-1.jar:/opt/hadoop-3.3.6/share/hadoop/common/lib/kerby-pkix-1.0.1.jar:/opt/hadoop-3.3.6/share/hadoop/common/lib/kerb-client-1.0.1.jar:/opt/hadoop-3.3.6/share/hadoop/common/lib/slf4j-api-1.7.36.jar:/opt/hadoop-3.3.6/share/hadoop/common/lib/netty-handler-4.1.89.Final.jar:/opt/hadoop-3.3.6/share/hadoop/common/lib/zookeeper-3.6.3.jar:/opt/hadoop-3.3.6/share/hadoop/common/lib/hadoop-shaded-guava-1.1.1.jar:/opt/hadoop-3.3.6/share/hadoop/common/lib/commons-beanutils-1.9.4.jar:/opt/hadoop-3.3.6/share/hadoop/common/lib/jetty-util-9.4.51.v20230217.jar:/opt/hadoop-3.3.6/share/hadoop/common/lib/commons-configuration2-2.8.0.jar:/opt/hadoop-3.3.6/share/hadoop/common/lib/jersey-json-1.20.jar:/opt/hadoop-3.3.6/share/hadoop/common/lib/listenablefuture-9999.0-empty-to-avoid-conflict-with-guava.jar:/opt/hadoop-3.3.6/share/hadoop/common/lib/netty-transport-udt-4.1.89.Final.jar:/opt/hadoop-3.3.6/share/hadoop/common/lib/audience-annotations-0.5.0.jar:/opt/hadoop-3.3.6/share/hadoop/common/lib/commons-compress-1.21.jar:/opt/hadoop-3.3.6/share/hadoop/common/lib/netty-codec-4.1.89.Final.jar:/opt/hadoop-3.3.6/share/hadoop/common/lib/netty-codec-memcache-4.1.89.Final.jar:/opt/hadoop-3.3.6/share/hadoop/common/lib/jaxb-api-2.2.11.jar:/opt/hadoop-3.3.6/share/hadoop/common/lib/commons-cli-1.2.jar:/opt/hadoop-3.3.6/share/hadoop/common/lib/jettison-1.5.4.jar:/opt/hadoop-3.3.6/share/hadoop/common/lib/netty-codec-smtp-4.1.89.Final.jar:/opt/hadoop-3.3.6/share/hadoop/common/lib/netty-transport-native-epoll-4.1.89.Final-linux-x86_64.jar:/opt/hadoop-3.3.6/share/hadoop/common/lib/jetty-http-9.4.51.v20230217.jar:/opt/hadoop-3.3.6/share/hadoop/common/lib/netty-common-4.1.89.Final.jar:/opt/hadoop-3.3.6/share/hadoop/common/lib/commons-daemon-1.0.13.jar:/opt/hadoop-3.3.6/share/hadoop/common/lib/httpcore-4.4.13.jar:/opt/hadoop-3.3.6/share/hadoop/common/lib/failureaccess-1.0.jar:/opt/hadoop-3.3.6/share/hadoop/common/lib/jcip-annotations-1.0-1.jar:/opt/hadoop-3.3.6/share/hadoop/common/lib/jakarta.activation-api-1.2.1.jar:/opt/hadoop-3.3.6/share/hadoop/common/lib/netty-codec-stomp-4.1.89.Final.jar:/opt/hadoop-3.3.6/share/hadoop/common/lib/netty-all-4.1.89.Final.jar:/opt/hadoop-3.3.6/share/hadoop/common/lib/protobuf-java-2.5.0.jar:/opt/hadoop-3.3.6/share/hadoop/common/lib/metrics-core-3.2.4.jar:/opt/hadoop-3.3.6/share/hadoop/common/lib/netty-transport-native-unix-common-4.1.89.Final.jar:/opt/hadoop-3.3.6/share/hadoop/common/lib/netty-resolver-dns-native-macos-4.1.89.Final-osx-x86_64.jar:/opt/hadoop-3.3.6/share/hadoop/common/lib/jackson-core-2.12.7.jar:/opt/hadoop-3.3.6/share/hadoop/common/lib/jsr311-api-1.1.1.jar:/opt/hadoop-3.3.6/share/hadoop/common/lib/jetty-servlet-9.4.51.v20230217.jar:/opt/hadoop-3.3.6/share/hadoop/common/lib/dnsjava-2.1.7.jar:/opt/hadoop-3.3.6/share/hadoop/common/lib/zookeeper-jute-3.6.3.jar:/opt/hadoop-3.3.6/share/hadoop/common/lib/netty-codec-redis-4.1.89.Final.jar:/opt/hadoop-3.3.6/share/hadoop/common/lib/jetty-webapp-9.4.51.v20230217.jar:/opt/hadoop-3.3.6/share/hadoop/common/lib/kerb-util-1.0.1.jar:/opt/hadoop-3.3.6/share/hadoop/common/lib/jackson-annotations-2.12.7.jar:/opt/hadoop-3.3.6/share/hadoop/common/lib/hadoop-annotations-3.3.6.jar:/opt/hadoop-3.3.6/share/hadoop/common/lib/jackson-databind-2.12.7.1.jar:/opt/hadoop-3.3.6/share/hadoop/common/lib/animal-sniffer-annotations-1.17.jar:/opt/hadoop-3.3.6/share/hadoop/common/lib/netty-handler-proxy-4.1.89.Final.jar:/opt/hadoop-3.3.6/share/hadoop/common/lib/paranamer-2.3.jar:/opt/hadoop-3.3.6/share/hadoop/common/lib/kerb-core-1.0.1.jar:/opt/hadoop-3.3.6/share/hadoop/common/lib/kerb-simplekdc-1.0.1.jar:/opt/hadoop-3.3.6/share/hadoop/common/lib/gson-2.9.0.jar:/opt/hadoop-3.3.6/share/hadoop/common/lib/kerb-admin-1.0.1.jar:/opt/hadoop-3.3.6/share/hadoop/common/lib/jetty-security-9.4.51.v20230217.jar:/opt/hadoop-3.3.6/share/hadoop/common/lib/netty-transport-native-kqueue-4.1.89.Final-osx-x86_64.jar:/opt/hadoop-3.3.6/share/hadoop/common/lib/re2j-1.1.jar:/opt/hadoop-3.3.6/share/hadoop/common/lib/httpclient-4.5.13.jar:/opt/hadoop-3.3.6/share/hadoop/common/lib/curator-client-5.2.0.jar:/opt/hadoop-3.3.6/share/hadoop/common/lib/netty-transport-classes-epoll-4.1.89.Final.jar:/opt/hadoop-3.3.6/share/hadoop/common/lib/netty-resolver-dns-4.1.89.Final.jar:/opt/hadoop-3.3.6/share/hadoop/common/lib/netty-resolver-4.1.89.Final.jar:/opt/hadoop-3.3.6/share/hadoop/common/lib/jetty-io-9.4.51.v20230217.jar:/opt/hadoop-3.3.6/share/hadoop/common/lib/commons-net-3.9.0.jar:/opt/hadoop-3.3.6/share/hadoop/common/lib/snappy-java-1.1.8.2.jar:/opt/hadoop-3.3.6/share/hadoop/common/lib/jackson-core-asl-1.9.13.jar:/opt/hadoop-3.3.6/share/hadoop/common/lib/woodstox-core-5.4.0.jar:/opt/hadoop-3.3.6/share/hadoop/common/lib/netty-transport-classes-kqueue-4.1.89.Final.jar:/opt/hadoop-3.3.6/share/hadoop/common/lib/kerby-xdr-1.0.1.jar:/opt/hadoop-3.3.6/share/hadoop/common/lib/netty-codec-mqtt-4.1.89.Final.jar:/opt/hadoop-3.3.6/share/hadoop/common/lib/nimbus-jose-jwt-9.8.1.jar:/opt/hadoop-3.3.6/share/hadoop/common/lib/netty-buffer-4.1.89.Final.jar:/opt/hadoop-3.3.6/share/hadoop/hdfs/hadoop-hdfs-rbf-3.3.6-tests.jar:/opt/hadoop-3.3.6/share/hadoop/hdfs/hadoop-hdfs-native-client-3.3.6-tests.jar:/opt/hadoop-3.3.6/share/hadoop/hdfs/hadoop-hdfs-3.3.6-tests.jar:/opt/hadoop-3.3.6/share/hadoop/hdfs/hadoop-hdfs-native-client-3.3.6.jar:/opt/hadoop-3.3.6/share/hadoop/hdfs/hadoop-hdfs-client-3.3.6.jar:/opt/hadoop-3.3.6/share/hadoop/hdfs/hadoop-hdfs-nfs-3.3.6.jar:/opt/hadoop-3.3.6/share/hadoop/hdfs/hadoop-hdfs-rbf-3.3.6.jar:/opt/hadoop-3.3.6/share/hadoop/hdfs/hadoop-hdfs-3.3.6.jar:/opt/hadoop-3.3.6/share/hadoop/hdfs/hadoop-hdfs-client-3.3.6-tests.jar:/opt/hadoop-3.3.6/share/hadoop/hdfs/hadoop-hdfs-httpfs-3.3.6.jar:/opt/hadoop-3.3.6/share/hadoop/hdfs/lib/netty-resolver-dns-native-macos-4.1.89.Final-osx-aarch_64.jar:/opt/hadoop-3.3.6/share/hadoop/hdfs/lib/netty-codec-socks-4.1.89.Final.jar:/opt/hadoop-3.3.6/share/hadoop/hdfs/lib/kerb-identity-1.0.1.jar:/opt/hadoop-3.3.6/share/hadoop/hdfs/lib/kerby-asn1-1.0.1.jar:/opt/hadoop-3.3.6/share/hadoop/hdfs/lib/HikariCP-java7-2.4.12.jar:/opt/hadoop-3.3.6/share/hadoop/hdfs/lib/commons-math3-3.1.1.jar:/opt/hadoop-3.3.6/share/hadoop/hdfs/lib/jetty-xml-9.4.51.v20230217.jar:/opt/hadoop-3.3.6/share/hadoop/hdfs/lib/kerb-crypto-1.0.1.jar:/opt/hadoop-3.3.6/share/hadoop/hdfs/lib/netty-codec-xml-4.1.89.Final.jar:/opt/hadoop-3.3.6/share/hadoop/hdfs/lib/netty-transport-sctp-4.1.89.Final.jar:/opt/hadoop-3.3.6/share/hadoop/hdfs/lib/commons-collections-3.2.2.jar:/opt/hadoop-3.3.6/share/hadoop/hdfs/lib/commons-codec-1.15.jar:/opt/hadoop-3.3.6/share/hadoop/hdfs/lib/jackson-mapper-asl-1.9.13.jar:/opt/hadoop-3.3.6/share/hadoop/hdfs/lib/reload4j-1.2.22.jar:/opt/hadoop-3.3.6/share/hadoop/hdfs/lib/jersey-server-1.19.4.jar:/opt/hadoop-3.3.6/share/hadoop/hdfs/lib/jsch-0.1.55.jar:/opt/hadoop-3.3.6/share/hadoop/hdfs/lib/kerby-util-1.0.1.jar:/opt/hadoop-3.3.6/share/hadoop/hdfs/lib/commons-io-2.8.0.jar:/opt/hadoop-3.3.6/share/hadoop/hdfs/lib/kotlin-stdlib-1.4.10.jar:/opt/hadoop-3.3.6/share/hadoop/hdfs/lib/token-provider-1.0.1.jar:/opt/hadoop-3.3.6/share/hadoop/hdfs/lib/stax2-api-4.2.1.jar:/opt/hadoop-3.3.6/share/hadoop/hdfs/lib/netty-codec-dns-4.1.89.Final.jar:/opt/hadoop-3.3.6/share/hadoop/hdfs/lib/avro-1.7.7.jar:/opt/hadoop-3.3.6/share/hadoop/hdfs/lib/commons-text-1.10.0.jar:/opt/hadoop-3.3.6/share/hadoop/hdfs/lib/netty-transport-native-kqueue-4.1.89.Final-osx-aarch_64.jar:/opt/hadoop-3.3.6/share/hadoop/hdfs/lib/hadoop-auth-3.3.6.jar:/opt/hadoop-3.3.6/share/hadoop/hdfs/lib/kerby-config-1.0.1.jar:/opt/hadoop-3.3.6/share/hadoop/hdfs/lib/j2objc-annotations-1.1.jar:/opt/hadoop-3.3.6/share/hadoop/hdfs/lib/commons-lang3-3.12.0.jar:/opt/hadoop-3.3.6/share/hadoop/hdfs/lib/jetty-server-9.4.51.v20230217.jar:/opt/hadoop-3.3.6/share/hadoop/hdfs/lib/jersey-servlet-1.19.4.jar:/opt/hadoop-3.3.6/share/hadoop/hdfs/lib/kerb-common-1.0.1.jar:/opt/hadoop-3.3.6/share/hadoop/hdfs/lib/hadoop-shaded-protobuf_3_7-1.1.1.jar:/opt/hadoop-3.3.6/share/hadoop/hdfs/lib/guava-27.0-jre.jar:/opt/hadoop-3.3.6/share/hadoop/hdfs/lib/netty-transport-rxtx-4.1.89.Final.jar:/opt/hadoop-3.3.6/share/hadoop/hdfs/lib/jersey-core-1.19.4.jar:/opt/hadoop-3.3.6/share/hadoop/hdfs/lib/commons-logging-1.1.3.jar:/opt/hadoop-3.3.6/share/hadoop/hdfs/lib/curator-recipes-5.2.0.jar:/opt/hadoop-3.3.6/share/hadoop/hdfs/lib/netty-resolver-dns-classes-macos-4.1.89.Final.jar:/opt/hadoop-3.3.6/share/hadoop/hdfs/lib/netty-handler-ssl-ocsp-4.1.89.Final.jar:/opt/hadoop-3.3.6/share/hadoop/hdfs/lib/okio-2.8.0.jar:/opt/hadoop-3.3.6/share/hadoop/hdfs/lib/netty-transport-native-epoll-4.1.89.Final-linux-aarch_64.jar:/opt/hadoop-3.3.6/share/hadoop/hdfs/lib/curator-framework-5.2.0.jar:/opt/hadoop-3.3.6/share/hadoop/hdfs/lib/netty-codec-http-4.1.89.Final.jar:/opt/hadoop-3.3.6/share/hadoop/hdfs/lib/netty-codec-http2-4.1.89.Final.jar:/opt/hadoop-3.3.6/share/hadoop/hdfs/lib/netty-codec-haproxy-4.1.89.Final.jar:/opt/hadoop-3.3.6/share/hadoop/hdfs/lib/netty-transport-4.1.89.Final.jar:/opt/hadoop-3.3.6/share/hadoop/hdfs/lib/checker-qual-2.5.2.jar:/opt/hadoop-3.3.6/share/hadoop/hdfs/lib/jsr305-3.0.2.jar:/opt/hadoop-3.3.6/share/hadoop/hdfs/lib/kerb-server-1.0.1.jar:/opt/hadoop-3.3.6/share/hadoop/hdfs/lib/jetty-util-ajax-9.4.51.v20230217.jar:/opt/hadoop-3.3.6/share/hadoop/hdfs/lib/javax.servlet-api-3.1.0.jar:/opt/hadoop-3.3.6/share/hadoop/hdfs/lib/json-simple-1.1.1.jar:/opt/hadoop-3.3.6/share/hadoop/hdfs/lib/jaxb-impl-2.2.3-1.jar:/opt/hadoop-3.3.6/share/hadoop/hdfs/lib/kerby-pkix-1.0.1.jar:/opt/hadoop-3.3.6/share/hadoop/hdfs/lib/kerb-client-1.0.1.jar:/opt/hadoop-3.3.6/share/hadoop/hdfs/lib/netty-handler-4.1.89.Final.jar:/opt/hadoop-3.3.6/share/hadoop/hdfs/lib/zookeeper-3.6.3.jar:/opt/hadoop-3.3.6/share/hadoop/hdfs/lib/hadoop-shaded-guava-1.1.1.jar:/opt/hadoop-3.3.6/share/hadoop/hdfs/lib/commons-beanutils-1.9.4.jar:/opt/hadoop-3.3.6/share/hadoop/hdfs/lib/jetty-util-9.4.51.v20230217.jar:/opt/hadoop-3.3.6/share/hadoop/hdfs/lib/commons-configuration2-2.8.0.jar:/opt/hadoop-3.3.6/share/hadoop/hdfs/lib/jersey-json-1.20.jar:/opt/hadoop-3.3.6/share/hadoop/hdfs/lib/listenablefuture-9999.0-empty-to-avoid-conflict-with-guava.jar:/opt/hadoop-3.3.6/share/hadoop/hdfs/lib/netty-transport-udt-4.1.89.Final.jar:/opt/hadoop-3.3.6/share/hadoop/hdfs/lib/audience-annotations-0.5.0.jar:/opt/hadoop-3.3.6/share/hadoop/hdfs/lib/commons-compress-1.21.jar:/opt/hadoop-3.3.6/share/hadoop/hdfs/lib/netty-codec-4.1.89.Final.jar:/opt/hadoop-3.3.6/share/hadoop/hdfs/lib/netty-codec-memcache-4.1.89.Final.jar:/opt/hadoop-3.3.6/share/hadoop/hdfs/lib/jaxb-api-2.2.11.jar:/opt/hadoop-3.3.6/share/hadoop/hdfs/lib/commons-cli-1.2.jar:/opt/hadoop-3.3.6/share/hadoop/hdfs/lib/jettison-1.5.4.jar:/opt/hadoop-3.3.6/share/hadoop/hdfs/lib/netty-codec-smtp-4.1.89.Final.jar:/opt/hadoop-3.3.6/share/hadoop/hdfs/lib/netty-transport-native-epoll-4.1.89.Final-linux-x86_64.jar:/opt/hadoop-3.3.6/share/hadoop/hdfs/lib/jetty-http-9.4.51.v20230217.jar:/opt/hadoop-3.3.6/share/hadoop/hdfs/lib/netty-common-4.1.89.Final.jar:/opt/hadoop-3.3.6/share/hadoop/hdfs/lib/commons-daemon-1.0.13.jar:/opt/hadoop-3.3.6/share/hadoop/hdfs/lib/httpcore-4.4.13.jar:/opt/hadoop-3.3.6/share/hadoop/hdfs/lib/failureaccess-1.0.jar:/opt/hadoop-3.3.6/share/hadoop/hdfs/lib/jcip-annotations-1.0-1.jar:/opt/hadoop-3.3.6/share/hadoop/hdfs/lib/jakarta.activation-api-1.2.1.jar:/opt/hadoop-3.3.6/share/hadoop/hdfs/lib/netty-codec-stomp-4.1.89.Final.jar:/opt/hadoop-3.3.6/share/hadoop/hdfs/lib/netty-all-4.1.89.Final.jar:/opt/hadoop-3.3.6/share/hadoop/hdfs/lib/protobuf-java-2.5.0.jar:/opt/hadoop-3.3.6/share/hadoop/hdfs/lib/metrics-core-3.2.4.jar:/opt/hadoop-3.3.6/share/hadoop/hdfs/lib/netty-transport-native-unix-common-4.1.89.Final.jar:/opt/hadoop-3.3.6/share/hadoop/hdfs/lib/netty-resolver-dns-native-macos-4.1.89.Final-osx-x86_64.jar:/opt/hadoop-3.3.6/share/hadoop/hdfs/lib/jackson-core-2.12.7.jar:/opt/hadoop-3.3.6/share/hadoop/hdfs/lib/jsr311-api-1.1.1.jar:/opt/hadoop-3.3.6/share/hadoop/hdfs/lib/jetty-servlet-9.4.51.v20230217.jar:/opt/hadoop-3.3.6/share/hadoop/hdfs/lib/re2j-1.1.jar:/opt/hadoop-3.3.6/share/hadoop/hdfs/lib/dnsjava-2.1.7.jar:/opt/hadoop-3.3.6/share/hadoop/hdfs/lib/zookeeper-jute-3.6.3.jar:/opt/hadoop-3.3.6/share/hadoop/hdfs/lib/netty-codec-redis-4.1.89.Final.jar:/opt/hadoop-3.3.6/share/hadoop/hdfs/lib/jetty-webapp-9.4.51.v20230217.jar:/opt/hadoop-3.3.6/share/hadoop/hdfs/lib/kerb-util-1.0.1.jar:/opt/hadoop-3.3.6/share/hadoop/hdfs/lib/jackson-annotations-2.12.7.jar:/opt/hadoop-3.3.6/share/hadoop/hdfs/lib/hadoop-annotations-3.3.6.jar:/opt/hadoop-3.3.6/share/hadoop/hdfs/lib/jackson-databind-2.12.7.1.jar:/opt/hadoop-3.3.6/share/hadoop/hdfs/lib/animal-sniffer-annotations-1.17.jar:/opt/hadoop-3.3.6/share/hadoop/hdfs/lib/netty-handler-proxy-4.1.89.Final.jar:/opt/hadoop-3.3.6/share/hadoop/hdfs/lib/paranamer-2.3.jar:/opt/hadoop-3.3.6/share/hadoop/hdfs/lib/kerb-core-1.0.1.jar:/opt/hadoop-3.3.6/share/hadoop/hdfs/lib/kerb-simplekdc-1.0.1.jar:/opt/hadoop-3.3.6/share/hadoop/hdfs/lib/netty-3.10.6.Final.jar:/opt/hadoop-3.3.6/share/hadoop/hdfs/lib/gson-2.9.0.jar:/opt/hadoop-3.3.6/share/hadoop/hdfs/lib/leveldbjni-all-1.8.jar:/opt/hadoop-3.3.6/share/hadoop/hdfs/lib/kerb-admin-1.0.1.jar:/opt/hadoop-3.3.6/share/hadoop/hdfs/lib/jetty-security-9.4.51.v20230217.jar:/opt/hadoop-3.3.6/share/hadoop/hdfs/lib/netty-transport-native-kqueue-4.1.89.Final-osx-x86_64.jar:/opt/hadoop-3.3.6/share/hadoop/hdfs/lib/httpclient-4.5.13.jar:/opt/hadoop-3.3.6/share/hadoop/hdfs/lib/curator-client-5.2.0.jar:/opt/hadoop-3.3.6/share/hadoop/hdfs/lib/netty-transport-classes-epoll-4.1.89.Final.jar:/opt/hadoop-3.3.6/share/hadoop/hdfs/lib/netty-resolver-dns-4.1.89.Final.jar:/opt/hadoop-3.3.6/share/hadoop/hdfs/lib/netty-resolver-4.1.89.Final.jar:/opt/hadoop-3.3.6/share/hadoop/hdfs/lib/jetty-io-9.4.51.v20230217.jar:/opt/hadoop-3.3.6/share/hadoop/hdfs/lib/okhttp-4.9.3.jar:/opt/hadoop-3.3.6/share/hadoop/hdfs/lib/commons-net-3.9.0.jar:/opt/hadoop-3.3.6/share/hadoop/hdfs/lib/snappy-java-1.1.8.2.jar:/opt/hadoop-3.3.6/share/hadoop/hdfs/lib/jackson-core-asl-1.9.13.jar:/opt/hadoop-3.3.6/share/hadoop/hdfs/lib/woodstox-core-5.4.0.jar:/opt/hadoop-3.3.6/share/hadoop/hdfs/lib/netty-transport-classes-kqueue-4.1.89.Final.jar:/opt/hadoop-3.3.6/share/hadoop/hdfs/lib/kerby-xdr-1.0.1.jar:/opt/hadoop-3.3.6/share/hadoop/hdfs/lib/netty-codec-mqtt-4.1.89.Final.jar:/opt/hadoop-3.3.6/share/hadoop/hdfs/lib/nimbus-jose-jwt-9.8.1.jar:/opt/hadoop-3.3.6/share/hadoop/hdfs/lib/netty-buffer-4.1.89.Final.jar:/opt/hadoop-3.3.6/share/hadoop/hdfs/lib/kotlin-stdlib-common-1.4.10.jar:/opt/hadoop-3.3.6/share/hadoop/yarn/hadoop-yarn-server-sharedcachemanager-3.3.6.jar:/opt/hadoop-3.3.6/share/hadoop/yarn/hadoop-yarn-server-applicationhistoryservice-3.3.6.jar:/opt/hadoop-3.3.6/share/hadoop/yarn/hadoop-yarn-registry-3.3.6.jar:/opt/hadoop-3.3.6/share/hadoop/yarn/hadoop-yarn-applications-mawo-core-3.3.6.jar:/opt/hadoop-3.3.6/share/hadoop/yarn/hadoop-yarn-client-3.3.6.jar:/opt/hadoop-3.3.6/share/hadoop/yarn/hadoop-yarn-server-nodemanager-3.3.6.jar:/opt/hadoop-3.3.6/share/hadoop/yarn/hadoop-yarn-server-resourcemanager-3.3.6.jar:/opt/hadoop-3.3.6/share/hadoop/yarn/hadoop-yarn-server-timeline-pluginstorage-3.3.6.jar:/opt/hadoop-3.3.6/share/hadoop/yarn/hadoop-yarn-server-router-3.3.6.jar:/opt/hadoop-3.3.6/share/hadoop/yarn/hadoop-yarn-server-tests-3.3.6.jar:/opt/hadoop-3.3.6/share/hadoop/yarn/hadoop-yarn-applications-distributedshell-3.3.6.jar:/opt/hadoop-3.3.6/share/hadoop/yarn/hadoop-yarn-services-core-3.3.6.jar:/opt/hadoop-3.3.6/share/hadoop/yarn/hadoop-yarn-server-web-proxy-3.3.6.jar:/opt/hadoop-3.3.6/share/hadoop/yarn/hadoop-yarn-services-api-3.3.6.jar:/opt/hadoop-3.3.6/share/hadoop/yarn/hadoop-yarn-common-3.3.6.jar:/opt/hadoop-3.3.6/share/hadoop/yarn/hadoop-yarn-server-common-3.3.6.jar:/opt/hadoop-3.3.6/share/hadoop/yarn/hadoop-yarn-applications-unmanaged-am-launcher-3.3.6.jar:/opt/hadoop-3.3.6/share/hadoop/yarn/hadoop-yarn-api-3.3.6.jar:/opt/hadoop-3.3.6/share/hadoop/yarn/lib/guice-servlet-4.0.jar:/opt/hadoop-3.3.6/share/hadoop/yarn/lib/java-util-1.9.0.jar:/opt/hadoop-3.3.6/share/hadoop/yarn/lib/objenesis-2.6.jar:/opt/hadoop-3.3.6/share/hadoop/yarn/lib/jakarta.xml.bind-api-2.3.2.jar:/opt/hadoop-3.3.6/share/hadoop/yarn/lib/fst-2.50.jar:/opt/hadoop-3.3.6/share/hadoop/yarn/lib/websocket-client-9.4.51.v20230217.jar:/opt/hadoop-3.3.6/share/hadoop/yarn/lib/jersey-client-1.19.4.jar:/opt/hadoop-3.3.6/share/hadoop/yarn/lib/bcpkix-jdk15on-1.68.jar:/opt/hadoop-3.3.6/share/hadoop/yarn/lib/jackson-jaxrs-json-provider-2.12.7.jar:/opt/hadoop-3.3.6/share/hadoop/yarn/lib/asm-tree-9.4.jar:/opt/hadoop-3.3.6/share/hadoop/yarn/lib/javax.inject-1.jar:/opt/hadoop-3.3.6/share/hadoop/yarn/lib/mssql-jdbc-6.2.1.jre7.jar:/opt/hadoop-3.3.6/share/hadoop/yarn/lib/snakeyaml-2.0.jar:/opt/hadoop-3.3.6/share/hadoop/yarn/lib/javax-websocket-server-impl-9.4.51.v20230217.jar:/opt/hadoop-3.3.6/share/hadoop/yarn/lib/websocket-api-9.4.51.v20230217.jar:/opt/hadoop-3.3.6/share/hadoop/yarn/lib/asm-commons-9.4.jar:/opt/hadoop-3.3.6/share/hadoop/yarn/lib/bcprov-jdk15on-1.68.jar:/opt/hadoop-3.3.6/share/hadoop/yarn/lib/geronimo-jcache_1.0_spec-1.0-alpha-1.jar:/opt/hadoop-3.3.6/share/hadoop/yarn/lib/jackson-jaxrs-base-2.12.7.jar:/opt/hadoop-3.3.6/share/hadoop/yarn/lib/ehcache-3.3.1.jar:/opt/hadoop-3.3.6/share/hadoop/yarn/lib/javax-websocket-client-impl-9.4.51.v20230217.jar:/opt/hadoop-3.3.6/share/hadoop/yarn/lib/jline-3.9.0.jar:/opt/hadoop-3.3.6/share/hadoop/yarn/lib/websocket-server-9.4.51.v20230217.jar:/opt/hadoop-3.3.6/share/hadoop/yarn/lib/javax.websocket-api-1.0.jar:/opt/hadoop-3.3.6/share/hadoop/yarn/lib/javax.websocket-client-api-1.0.jar:/opt/hadoop-3.3.6/share/hadoop/yarn/lib/jetty-plus-9.4.51.v20230217.jar:/opt/hadoop-3.3.6/share/hadoop/yarn/lib/jetty-client-9.4.51.v20230217.jar:/opt/hadoop-3.3.6/share/hadoop/yarn/lib/jetty-annotations-9.4.51.v20230217.jar:/opt/hadoop-3.3.6/share/hadoop/yarn/lib/websocket-servlet-9.4.51.v20230217.jar:/opt/hadoop-3.3.6/share/hadoop/yarn/lib/swagger-annotations-1.5.4.jar:/opt/hadoop-3.3.6/share/hadoop/yarn/lib/json-io-2.5.1.jar:/opt/hadoop-3.3.6/share/hadoop/yarn/lib/jetty-jndi-9.4.51.v20230217.jar:/opt/hadoop-3.3.6/share/hadoop/yarn/lib/aopalliance-1.0.jar:/opt/hadoop-3.3.6/share/hadoop/yarn/lib/websocket-common-9.4.51.v20230217.jar:/opt/hadoop-3.3.6/share/hadoop/yarn/lib/jersey-guice-1.19.4.jar:/opt/hadoop-3.3.6/share/hadoop/yarn/lib/jna-5.2.0.jar:/opt/hadoop-3.3.6/share/hadoop/yarn/lib/jackson-module-jaxb-annotations-2.12.7.jar:/opt/hadoop-3.3.6/share/hadoop/yarn/lib/guice-4.0.jar
2023-08-14 19:24:45,664 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - --------------------------------------------------------------------------------
2023-08-14 19:24:45,665 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Registered UNIX signal handlers for [TERM, HUP, INT]
2023-08-14 19:24:45,672 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - YARN daemon is running as: root Yarn client user obtainer: root
2023-08-14 19:24:45,688 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: yarn.flink-dist-jar, file:/opt/flink-1.16.2/lib/flink-dist-1.16.2.jar
2023-08-14 19:24:45,688 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: jobmanager.execution.failover-strategy, region
2023-08-14 19:24:45,688 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: high-availability.cluster-id, application_1599911135538_0162
2023-08-14 19:24:45,688 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: jobmanager.rpc.address, master
2023-08-14 19:24:45,688 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: jobmanager.bind-host, 0.0.0.0
2023-08-14 19:24:45,689 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: rest.bind-port, 8082-8190
2023-08-14 19:24:45,689 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: parallelism.default, 1
2023-08-14 19:24:45,689 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: taskmanager.numberOfTaskSlots, 1
2023-08-14 19:24:45,689 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: taskmanager.memory.process.size, 1 gb
2023-08-14 19:24:45,689 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: taskmanager.bind-host, 0.0.0.0
2023-08-14 19:24:45,689 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: state.backend.incremental, true
2023-08-14 19:24:45,689 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: restart-strategy.fixed-delay.attempts, 2147483647
2023-08-14 19:24:45,689 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: execution.target, yarn-session
2023-08-14 19:24:45,689 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: jobmanager.memory.process.size, 1 gb
2023-08-14 19:24:45,690 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: yarn.ship-files, /opt/chunjun1.16/chunjun-dist
2023-08-14 19:24:45,690 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: jobmanager.rpc.port, 6123
2023-08-14 19:24:45,690 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: rest.bind-address, 0.0.0.0
2023-08-14 19:24:45,690 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: execution.checkpointing.interval, 10min
2023-08-14 19:24:45,690 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: execution.attached, false
2023-08-14 19:24:45,690 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: internal.cluster.execution-mode, NORMAL
2023-08-14 19:24:45,690 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: taskmanager.memory.managed.size, 50m
2023-08-14 19:24:45,690 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: rest.address, master
2023-08-14 19:24:45,690 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: state.backend, rocksdb
2023-08-14 19:24:45,691 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: restart-strategy, fixed-delay
2023-08-14 19:24:45,691 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: $internal.deployment.config-dir, /opt/flink-1.16.2/conf
2023-08-14 19:24:45,691 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: $internal.yarn.log-config-file, /opt/flink-1.16.2/conf/log4j.properties
2023-08-14 19:24:45,691 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading dynamic configuration property: jobmanager.memory.off-heap.size, 134217728b
2023-08-14 19:24:45,691 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading dynamic configuration property: jobmanager.memory.jvm-overhead.min, 201326592b
2023-08-14 19:24:45,691 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading dynamic configuration property: jobmanager.memory.jvm-metaspace.size, 268435456b
2023-08-14 19:24:45,691 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading dynamic configuration property: jobmanager.memory.heap.size, 469762048b
2023-08-14 19:24:45,691 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading dynamic configuration property: jobmanager.memory.jvm-overhead.max, 201326592b
2023-08-14 19:24:45,742 INFO org.apache.flink.runtime.clusterframework.BootstrapTools [] - Setting directories for temporary files to: /tmp/hadoop-hadoop/nm-local-dir/usercache/root/appcache/application_1599911135538_0162
2023-08-14 19:24:45,758 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Starting YarnSessionClusterEntrypoint.
2023-08-14 19:24:45,801 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Install default filesystem.
2023-08-14 19:24:45,950 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Install security context.
2023-08-14 19:24:46,037 INFO org.apache.flink.runtime.security.modules.HadoopModule [] - Hadoop user set to root (auth:SIMPLE)
2023-08-14 19:24:46,045 INFO org.apache.flink.runtime.security.modules.JaasModule [] - Jaas file will be created as /tmp/hadoop-hadoop/nm-local-dir/usercache/root/appcache/application_1599911135538_0162/jaas-8097113014421733061.conf.
2023-08-14 19:24:46,057 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Initializing cluster services.
2023-08-14 19:24:46,069 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Using working directory: WorkingDirectory(/tmp/hadoop-hadoop/nm-local-dir/usercache/root/appcache/application_1599911135538_0162/jm_3a80f944ee90c7545e1cabe222292f2e).
2023-08-14 19:24:46,543 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcServiceUtils [] - Trying to start actor system, external address master:0, bind address 0.0.0.0:0.
2023-08-14 19:24:47,518 INFO akka.event.slf4j.Slf4jLogger [] - Slf4jLogger started
2023-08-14 19:24:47,557 INFO akka.remote.RemoteActorRefProvider [] - Akka Cluster not in use - enabling unsafe features anyway because akka.remote.use-unsafe-remote-features-outside-cluster has been enabled.
2023-08-14 19:24:47,558 INFO akka.remote.Remoting [] - Starting remoting
2023-08-14 19:24:47,839 INFO akka.remote.Remoting [] - Remoting started; listening on addresses :[akka.tcp://flink@master:36669]
2023-08-14 19:24:48,003 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcServiceUtils [] - Actor system started at akka.tcp://flink@master:36669
2023-08-14 19:24:48,042 WARN org.apache.flink.configuration.Configuration [] - Config uses deprecated configuration key 'web.port' instead of proper key 'rest.port'
2023-08-14 19:24:48,055 INFO org.apache.flink.runtime.blob.BlobServer [] - Created BLOB server storage directory /tmp/hadoop-hadoop/nm-local-dir/usercache/root/appcache/application_1599911135538_0162/jm_3a80f944ee90c7545e1cabe222292f2e/blobStorage
2023-08-14 19:24:48,061 INFO org.apache.flink.runtime.blob.BlobServer [] - Started BLOB server at 0.0.0.0:41499 - max concurrent requests: 50 - max backlog: 1000
2023-08-14 19:24:48,070 INFO org.apache.flink.runtime.security.token.KerberosDelegationTokenManagerFactory [] - Cannot use kerberos delegation token manager no valid kerberos credentials provided.
2023-08-14 19:24:48,084 INFO org.apache.flink.runtime.metrics.MetricRegistryImpl [] - No metrics reporter configured, no metrics will be exposed/reported.
2023-08-14 19:24:48,090 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcServiceUtils [] - Trying to start actor system, external address master:0, bind address 0.0.0.0:0.
2023-08-14 19:24:48,115 INFO akka.event.slf4j.Slf4jLogger [] - Slf4jLogger started
2023-08-14 19:24:48,121 INFO akka.remote.RemoteActorRefProvider [] - Akka Cluster not in use - enabling unsafe features anyway because akka.remote.use-unsafe-remote-features-outside-cluster has been enabled.
2023-08-14 19:24:48,121 INFO akka.remote.Remoting [] - Starting remoting
2023-08-14 19:24:48,135 INFO akka.remote.Remoting [] - Remoting started; listening on addresses :[akka.tcp://flink-metrics@master:37015]
2023-08-14 19:24:48,151 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcServiceUtils [] - Actor system started at akka.tcp://flink-metrics@master:37015
2023-08-14 19:24:48,171 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService [] - Starting RPC endpoint for org.apache.flink.runtime.metrics.dump.MetricQueryService at akka://flink-metrics/user/rpc/MetricQueryService .
2023-08-14 19:24:48,205 INFO org.apache.flink.runtime.dispatcher.FileExecutionGraphInfoStore [] - Initializing FileExecutionGraphInfoStore: Storage directory /tmp/hadoop-hadoop/nm-local-dir/usercache/root/appcache/application_1599911135538_0162/executionGraphStore-f0073135-9dc8-4b07-912b-6c58df64b883, expiration time 3600000, maximum cache size 52428800 bytes.
2023-08-14 19:24:48,283 INFO org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint [] - Upload directory /tmp/flink-web-df56aad0-24ac-49a5-9243-6caff067b1e0/flink-web-upload does not exist.
2023-08-14 19:24:48,284 INFO org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint [] - Created directory /tmp/flink-web-df56aad0-24ac-49a5-9243-6caff067b1e0/flink-web-upload for file uploads.
2023-08-14 19:24:48,288 INFO org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint [] - Starting rest endpoint.

Code of Conduct

Activity

  1. ysq5202121 commented on Aug 14, 2023

    @ysq5202121
    Author

    2023-08-14 19:24:48,693 INFO org.apache.flink.runtime.webmonitor.WebMonitorUtils [] - Determined location of main cluster component log file: /opt/hadoop-3.3.6/logs/userlogs/application_1599911135538_0162/container_1599911135538_0162_01_000001/jobmanager.log
    2023-08-14 19:24:48,694 INFO org.apache.flink.runtime.webmonitor.WebMonitorUtils [] - Determined location of main cluster component stdout file: /opt/hadoop-3.3.6/logs/userlogs/application_1599911135538_0162/container_1599911135538_0162_01_000001/jobmanager.out
    2023-08-14 19:24:48,955 INFO org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint [] - Rest endpoint listening at 10.4.24.251:8082
    2023-08-14 19:24:48,957 INFO org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint [] - http://10.4.24.251:8082 was granted leadership with leaderSessionID=00000000-0000-0000-0000-000000000000
    2023-08-14 19:24:48,958 INFO org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint [] - Web frontend listening at http://10.4.24.251:8082.
    2023-08-14 19:24:48,979 INFO org.apache.flink.runtime.util.config.memory.ProcessMemoryUtils [] - The derived from fraction jvm overhead memory (102.400mb (107374184 bytes)) is less than its min value 192.000mb (201326592 bytes), min value will be used instead
    2023-08-14 19:24:48,980 INFO org.apache.flink.runtime.util.config.memory.ProcessMemoryUtils [] - The derived from fraction network memory (57.600mb (60397978 bytes)) is less than its min value 64.000mb (67108864 bytes), min value will be used instead
    2023-08-14 19:24:49,005 INFO org.apache.flink.runtime.dispatcher.runner.DefaultDispatcherRunner [] - DefaultDispatcherRunner was granted leadership with leader id 00000000-0000-0000-0000-000000000000. Creating new DispatcherLeaderProcess.
    2023-08-14 19:24:49,015 INFO org.apache.flink.runtime.dispatcher.runner.SessionDispatcherLeaderProcess [] - Start SessionDispatcherLeaderProcess.
    2023-08-14 19:24:49,018 INFO org.apache.flink.runtime.resourcemanager.ResourceManagerServiceImpl [] - Starting resource manager service.
    2023-08-14 19:24:49,021 INFO org.apache.flink.runtime.resourcemanager.ResourceManagerServiceImpl [] - Resource manager service is granted leadership with session id 00000000-0000-0000-0000-000000000000.
    2023-08-14 19:24:49,030 INFO org.apache.flink.runtime.dispatcher.runner.SessionDispatcherLeaderProcess [] - Recover all persisted job graphs that are not finished, yet.
    2023-08-14 19:24:49,030 INFO org.apache.flink.runtime.dispatcher.runner.SessionDispatcherLeaderProcess [] - Successfully recovered 0 persisted job graphs.
    2023-08-14 19:24:49,060 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService [] - Starting RPC endpoint for org.apache.flink.runtime.dispatcher.StandaloneDispatcher at akka://flink/user/rpc/dispatcher_0 .
    2023-08-14 19:24:49,066 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: yarn.flink-dist-jar, file:/opt/flink-1.16.2/lib/flink-dist-1.16.2.jar
    2023-08-14 19:24:49,066 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: jobmanager.execution.failover-strategy, region
    2023-08-14 19:24:49,067 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: high-availability.cluster-id, application_1599911135538_0162
    2023-08-14 19:24:49,067 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: jobmanager.rpc.address, master
    2023-08-14 19:24:49,067 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: jobmanager.bind-host, 0.0.0.0
    2023-08-14 19:24:49,067 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: rest.bind-port, 8082-8190
    2023-08-14 19:24:49,067 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: parallelism.default, 1
    2023-08-14 19:24:49,067 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: taskmanager.numberOfTaskSlots, 1
    2023-08-14 19:24:49,067 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: taskmanager.memory.process.size, 1 gb
    2023-08-14 19:24:49,067 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: taskmanager.bind-host, 0.0.0.0
    2023-08-14 19:24:49,067 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: state.backend.incremental, true
    2023-08-14 19:24:49,067 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: restart-strategy.fixed-delay.attempts, 2147483647
    2023-08-14 19:24:49,067 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: execution.target, yarn-session
    2023-08-14 19:24:49,067 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: jobmanager.memory.process.size, 1 gb
    2023-08-14 19:24:49,068 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: yarn.ship-files, /opt/chunjun1.16/chunjun-dist
    2023-08-14 19:24:49,068 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: jobmanager.rpc.port, 6123
    2023-08-14 19:24:49,068 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: rest.bind-address, 0.0.0.0
    2023-08-14 19:24:49,068 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: execution.checkpointing.interval, 10min
    2023-08-14 19:24:49,068 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: execution.attached, false
    2023-08-14 19:24:49,068 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: internal.cluster.execution-mode, NORMAL
    2023-08-14 19:24:49,068 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: taskmanager.memory.managed.size, 50m
    2023-08-14 19:24:49,068 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: rest.address, master
    2023-08-14 19:24:49,068 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: state.backend, rocksdb
    2023-08-14 19:24:49,068 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: restart-strategy, fixed-delay
    2023-08-14 19:24:49,068 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: $internal.deployment.config-dir, /opt/flink-1.16.2/conf
    2023-08-14 19:24:49,069 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: $internal.yarn.log-config-file, /opt/flink-1.16.2/conf/log4j.properties
    2023-08-14 19:24:49,170 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService [] - Starting RPC endpoint for org.apache.flink.runtime.resourcemanager.active.ActiveResourceManager at akka://flink/user/rpc/resourcemanager_1 .
    2023-08-14 19:24:49,185 INFO org.apache.flink.runtime.resourcemanager.active.ActiveResourceManager [] - Starting the resource manager.
    2023-08-14 19:24:49,242 INFO org.apache.hadoop.yarn.client.RMProxy [] - Connecting to ResourceManager at /0.0.0.0:8030
    2023-08-14 19:24:49,401 INFO org.apache.flink.runtime.resourcemanager.slotmanager.DeclarativeSlotManager [] - Closing the slot manager.
    2023-08-14 19:24:49,401 INFO org.apache.flink.runtime.resourcemanager.slotmanager.DeclarativeSlotManager [] - Suspending the slot manager.
    2023-08-14 19:24:49,402 ERROR org.apache.flink.runtime.resourcemanager.active.ActiveResourceManager [] - Fatal error occurred in ResourceManager.
    org.apache.flink.runtime.resourcemanager.exceptions.ResourceManagerException: Could not start the ResourceManager akka.tcp://flink@master:36669/user/rpc/resourcemanager_1
    at org.apache.flink.runtime.resourcemanager.ResourceManager.onStart(ResourceManager.java:246) ~[chunjun-restore-mysql.jar:?]
    at org.apache.flink.runtime.rpc.RpcEndpoint.internalCallOnStart(RpcEndpoint.java:198) ~[chunjun-restore-mysql.jar:?]
    at org.apache.flink.runtime.rpc.akka.AkkaRpcActor$StoppedState.lambda$start$0(AkkaRpcActor.java:622) ~[flink-rpc-akka_88413c57-f272-4ca3-8f5c-cb0dfd17667f.jar:1.16.1]
    at org.apache.flink.runtime.concurrent.akka.ClassLoadingUtils.runWithContextClassLoader(ClassLoadingUtils.java:68) ~[flink-rpc-akka_88413c57-f272-4ca3-8f5c-cb0dfd17667f.jar:1.16.1]
    at org.apache.flink.runtime.rpc.akka.AkkaRpcActor$StoppedState.start(AkkaRpcActor.java:621) ~[flink-rpc-akka_88413c57-f272-4ca3-8f5c-cb0dfd17667f.jar:1.16.1]
    at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleControlMessage(AkkaRpcActor.java:190) ~[flink-rpc-akka_88413c57-f272-4ca3-8f5c-cb0dfd17667f.jar:1.16.1]
    at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24) [flink-rpc-akka_88413c57-f272-4ca3-8f5c-cb0dfd17667f.jar:1.16.1]
    at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20) [flink-rpc-akka_88413c57-f272-4ca3-8f5c-cb0dfd17667f.jar:1.16.1]
    at scala.PartialFunction.applyOrElse(PartialFunction.scala:123) [flink-rpc-akka_88413c57-f272-4ca3-8f5c-cb0dfd17667f.jar:1.16.1]
    at scala.PartialFunction.applyOrElse$(PartialFunction.scala:122) [flink-rpc-akka_88413c57-f272-4ca3-8f5c-cb0dfd17667f.jar:1.16.1]
    at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20) [flink-rpc-akka_88413c57-f272-4ca3-8f5c-cb0dfd17667f.jar:1.16.1]
    at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:171) [flink-rpc-akka_88413c57-f272-4ca3-8f5c-cb0dfd17667f.jar:1.16.1]
    at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:172) [flink-rpc-akka_88413c57-f272-4ca3-8f5c-cb0dfd17667f.jar:1.16.1]
    at akka.actor.Actor.aroundReceive(Actor.scala:537) [flink-rpc-akka_88413c57-f272-4ca3-8f5c-cb0dfd17667f.jar:1.16.1]
    at akka.actor.Actor.aroundReceive$(Actor.scala:535) [flink-rpc-akka_88413c57-f272-4ca3-8f5c-cb0dfd17667f.jar:1.16.1]
    at akka.actor.AbstractActor.aroundReceive(AbstractActor.scala:220) [flink-rpc-akka_88413c57-f272-4ca3-8f5c-cb0dfd17667f.jar:1.16.1]
    at akka.actor.ActorCell.receiveMessage(ActorCell.scala:580) [flink-rpc-akka_88413c57-f272-4ca3-8f5c-cb0dfd17667f.jar:1.16.1]
    at akka.actor.ActorCell.invoke(ActorCell.scala:548) [flink-rpc-akka_88413c57-f272-4ca3-8f5c-cb0dfd17667f.jar:1.16.1]
    at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270) [flink-rpc-akka_88413c57-f272-4ca3-8f5c-cb0dfd17667f.jar:1.16.1]
    at akka.dispatch.Mailbox.run(Mailbox.scala:231) [flink-rpc-akka_88413c57-f272-4ca3-8f5c-cb0dfd17667f.jar:1.16.1]
    at akka.dispatch.Mailbox.exec(Mailbox.scala:243) [flink-rpc-akka_88413c57-f272-4ca3-8f5c-cb0dfd17667f.jar:1.16.1]
    at java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:289) [?:1.8.0_372]
    at java.util.concurrent.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1056) [?:1.8.0_372]
    at java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1692) [?:1.8.0_372]
    at java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) [?:1.8.0_372]
    Caused by: org.apache.flink.runtime.resourcemanager.exceptions.ResourceManagerException: Cannot initialize resource provider.
    at org.apache.flink.runtime.resourcemanager.active.ActiveResourceManager.initialize(ActiveResourceManager.java:177) ~[chunjun-restore-mysql.jar:?]
    at org.apache.flink.runtime.resourcemanager.ResourceManager.startResourceManagerServices(ResourceManager.java:269) ~[chunjun-restore-mysql.jar:?]
    at org.apache.flink.runtime.resourcemanager.ResourceManager.onStart(ResourceManager.java:241) ~[chunjun-restore-mysql.jar:?]
    ... 24 more
    Caused by: org.apache.flink.runtime.resourcemanager.exceptions.ResourceManagerException: Could not start resource manager client.
    at org.apache.flink.yarn.YarnResourceManagerDriver.initializeInternal(YarnResourceManagerDriver.java:195) ~[chunjun-restore-mysql.jar:?]
    at org.apache.flink.runtime.resourcemanager.active.AbstractResourceManagerDriver.initialize(AbstractResourceManagerDriver.java:92) ~[chunjun-restore-mysql.jar:?]
    at org.apache.flink.runtime.resourcemanager.active.ActiveResourceManager.initialize(ActiveResourceManager.java:171) ~[chunjun-restore-mysql.jar:?]
    at org.apache.flink.runtime.resourcemanager.ResourceManager.startResourceManagerServices(ResourceManager.java:269) ~[chunjun-restore-mysql.jar:?]
    at org.apache.flink.runtime.resourcemanager.ResourceManager.onStart(ResourceManager.java:241) ~[chunjun-restore-mysql.jar:?]

  2. ysq5202121 commented on Aug 14, 2023

    @ysq5202121
    Author
    ... 24 more
    

    Caused by: java.lang.ClassCastException: org.apache.hadoop.yarn.proto.YarnServiceProtos$RegisterApplicationMasterRequestProto cannot be cast to com.google.protobuf.Message
    at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:226) ~[chunjun-connector-arctic.jar:?]
    at com.sun.proxy.$Proxy31.registerApplicationMaster(Unknown Source) ~[?:?]
    at org.apache.hadoop.yarn.api.impl.pb.client.ApplicationMasterProtocolPBClientImpl.registerApplicationMaster(ApplicationMasterProtocolPBClientImpl.java:107) ~[flink-shaded-hadoop-3-uber-3.1.1.7.2.9.0-173-9.0.jar:3.1.1.7.2.9.0-173-9.0]
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_372]
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_372]
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_372]
    at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_372]
    at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:191) ~[chunjun-connector-arctic.jar:?]
    at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:102) ~[chunjun-connector-arctic.jar:?]
    at com.sun.proxy.$Proxy32.registerApplicationMaster(Unknown Source) ~[?:?]
    at org.apache.hadoop.yarn.client.api.impl.AMRMClientImpl.registerApplicationMaster(AMRMClientImpl.java:247) ~[flink-shaded-hadoop-3-uber-3.1.1.7.2.9.0-173-9.0.jar:3.1.1.7.2.9.0-173-9.0]
    at org.apache.hadoop.yarn.client.api.impl.AMRMClientImpl.registerApplicationMaster(AMRMClientImpl.java:234) ~[flink-shaded-hadoop-3-uber-3.1.1.7.2.9.0-173-9.0.jar:3.1.1.7.2.9.0-173-9.0]
    at org.apache.hadoop.yarn.client.api.async.impl.AMRMClientAsyncImpl.registerApplicationMaster(AMRMClientAsyncImpl.java:201) ~[flink-shaded-hadoop-3-uber-3.1.1.7.2.9.0-173-9.0.jar:3.1.1.7.2.9.0-173-9.0]
    at org.apache.hadoop.yarn.client.api.async.impl.AMRMClientAsyncImpl.registerApplicationMaster(AMRMClientAsyncImpl.java:180) ~[flink-shaded-hadoop-3-uber-3.1.1.7.2.9.0-173-9.0.jar:3.1.1.7.2.9.0-173-9.0]
    at org.apache.flink.yarn.YarnResourceManagerDriver.registerApplicationMaster(YarnResourceManagerDriver.java:525) ~[chunjun-restore-mysql.jar:?]
    at org.apache.flink.yarn.YarnResourceManagerDriver.initializeInternal(YarnResourceManagerDriver.java:186) ~[chunjun-restore-mysql.jar:?]
    at org.apache.flink.runtime.resourcemanager.active.AbstractResourceManagerDriver.initialize(AbstractResourceManagerDriver.java:92) ~[chunjun-restore-mysql.jar:?]
    at org.apache.flink.runtime.resourcemanager.active.ActiveResourceManager.initialize(ActiveResourceManager.java:171) ~[chunjun-restore-mysql.jar:?]
    at org.apache.flink.runtime.resourcemanager.ResourceManager.startResourceManagerServices(ResourceManager.java:269) ~[chunjun-restore-mysql.jar:?]
    at org.apache.flink.runtime.resourcemanager.ResourceManager.onStart(ResourceManager.java:241) ~[chunjun-restore-mysql.jar:?]
    ... 24 more
    2023-08-14 19:24:49,414 ERROR org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Fatal error occurred in the cluster entrypoint.
    org.apache.flink.runtime.resourcemanager.exceptions.ResourceManagerException: Could not start the ResourceManager akka.tcp://flink@master:36669/user/rpc/resourcemanager_1
    at org.apache.flink.runtime.resourcemanager.ResourceManager.onStart(ResourceManager.java:246) ~[chunjun-restore-mysql.jar:?]
    at org.apache.flink.runtime.rpc.RpcEndpoint.internalCallOnStart(RpcEndpoint.java:198) ~[chunjun-restore-mysql.jar:?]
    at org.apache.flink.runtime.rpc.akka.AkkaRpcActor$StoppedState.lambda$start$0(AkkaRpcActor.java:622) ~[flink-rpc-akka_88413c57-f272-4ca3-8f5c-cb0dfd17667f.jar:1.16.1]
    at org.apache.flink.runtime.concurrent.akka.ClassLoadingUtils.runWithContextClassLoader(ClassLoadingUtils.java:68) ~[flink-rpc-akka_88413c57-f272-4ca3-8f5c-cb0dfd17667f.jar:1.16.1]
    at org.apache.flink.runtime.rpc.akka.AkkaRpcActor$StoppedState.start(AkkaRpcActor.java:621) ~[flink-rpc-akka_88413c57-f272-4ca3-8f5c-cb0dfd17667f.jar:1.16.1]
    at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleControlMessage(AkkaRpcActor.java:190) ~[flink-rpc-akka_88413c57-f272-4ca3-8f5c-cb0dfd17667f.jar:1.16.1]
    at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24) [flink-rpc-akka_88413c57-f272-4ca3-8f5c-cb0dfd17667f.jar:1.16.1]
    at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20) [flink-rpc-akka_88413c57-f272-4ca3-8f5c-cb0dfd17667f.jar:1.16.1]
    at scala.PartialFunction.applyOrElse(PartialFunction.scala:123) [flink-rpc-akka_88413c57-f272-4ca3-8f5c-cb0dfd17667f.jar:1.16.1]
    at scala.PartialFunction.applyOrElse$(PartialFunction.scala:122) [flink-rpc-akka_88413c57-f272-4ca3-8f5c-cb0dfd17667f.jar:1.16.1]
    at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20) [flink-rpc-akka_88413c57-f272-4ca3-8f5c-cb0dfd17667f.jar:1.16.1]
    at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:171) [flink-rpc-akka_88413c57-f272-4ca3-8f5c-cb0dfd17667f.jar:1.16.1]
    at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:172) [flink-rpc-akka_88413c57-f272-4ca3-8f5c-cb0dfd17667f.jar:1.16.1]
    at akka.actor.Actor.aroundReceive(Actor.scala:537) [flink-rpc-akka_88413c57-f272-4ca3-8f5c-cb0dfd17667f.jar:1.16.1]
    at akka.actor.Actor.aroundReceive$(Actor.scala:535) [flink-rpc-akka_88413c57-f272-4ca3-8f5c-cb0dfd17667f.jar:1.16.1]
    at akka.actor.AbstractActor.aroundReceive(AbstractActor.scala:220) [flink-rpc-akka_88413c57-f272-4ca3-8f5c-cb0dfd17667f.jar:1.16.1]
    at akka.actor.ActorCell.receiveMessage(ActorCell.scala:580) [flink-rpc-akka_88413c57-f272-4ca3-8f5c-cb0dfd17667f.jar:1.16.1]
    at akka.actor.ActorCell.invoke(ActorCell.scala:548) [flink-rpc-akka_88413c57-f272-4ca3-8f5c-cb0dfd17667f.jar:1.16.1]
    at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270) [flink-rpc-akka_88413c57-f272-4ca3-8f5c-cb0dfd17667f.jar:1.16.1]
    at akka.dispatch.Mailbox.run(Mailbox.scala:231) [flink-rpc-akka_88413c57-f272-4ca3-8f5c-cb0dfd17667f.jar:1.16.1]
    at akka.dispatch.Mailbox.exec(Mailbox.scala:243) [flink-rpc-akka_88413c57-f272-4ca3-8f5c-cb0dfd17667f.jar:1.16.1]
    at java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:289) [?:1.8.0_372]
    at java.util.concurrent.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1056) [?:1.8.0_372]
    at java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1692) [?:1.8.0_372]
    at java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) [?:1.8.0_372]
    Caused by: org.apache.flink.runtime.resourcemanager.exceptions.ResourceManagerException: Cannot initialize resource provider.
    at org.apache.flink.runtime.resourcemanager.active.ActiveResourceManager.initialize(ActiveResourceManager.java:177) ~[chunjun-restore-mysql.jar:?]
    at org.apache.flink.runtime.resourcemanager.ResourceManager.startResourceManagerServices(ResourceManager.java:269) ~[chunjun-restore-mysql.jar:?]
    at org.apache.flink.runtime.resourcemanager.ResourceManager.onStart(ResourceManager.java:241) ~[chunjun-restore-mysql.jar:?]
    ... 24 more
    Caused by: org.apache.flink.runtime.resourcemanager.exceptions.ResourceManagerException: Could not start resource manager client.
    at org.apache.flink.yarn.YarnResourceManagerDriver.initializeInternal(YarnResourceManagerDriver.java:195) ~[chunjun-restore-mysql.jar:?]
    at org.apache.flink.runtime.resourcemanager.active.AbstractResourceManagerDriver.initialize(AbstractResourceManagerDriver.java:92) ~[chunjun-restore-mysql.jar:?]
    at org.apache.flink.runtime.resourcemanager.active.ActiveResourceManager.initialize(ActiveResourceManager.java:171) ~[chunjun-restore-mysql.jar:?]
    at org.apache.flink.runtime.resourcemanager.ResourceManager.startResourceManagerServices(ResourceManager.java:269) ~[chunjun-restore-mysql.jar:?]
    at org.apache.flink.runtime.resourcemanager.ResourceManager.onStart(ResourceManager.java:241) ~[chunjun-restore-mysql.jar:?]
    ... 24 more
    Caused by: java.lang.ClassCastException: org.apache.hadoop.yarn.proto.YarnServiceProtos$RegisterApplicationMasterRequestProto cannot be cast to com.google.protobuf.Message
    at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:226) ~[chunjun-connector-arctic.jar:?]
    at com.sun.proxy.$Proxy31.registerApplicationMaster(Unknown Source) ~[?:?]
    at org.apache.hadoop.yarn.api.impl.pb.client.ApplicationMasterProtocolPBClientImpl.registerApplicationMaster(ApplicationMasterProtocolPBClientImpl.java:107) ~[flink-shaded-hadoop-3-uber-3.1.1.7.2.9.0-173-9.0.jar:3.1.1.7.2.9.0-173-9.0]
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_372]
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_372]
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_372]
    at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_372]
    at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:191) ~[chunjun-connector-arctic.jar:?]
    at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:102) ~[chunjun-connector-arctic.jar:?]
    at com.sun.proxy.$Proxy32.registerApplicationMaster(Unknown Source) ~[?:?]
    at org.apache.hadoop.yarn.client.api.impl.AMRMClientImpl.registerApplicationMaster(AMRMClientImpl.java:247) ~[flink-shaded-hadoop-3-uber-3.1.1.7.2.9.0-173-9.0.jar:3.1.1.7.2.9.0-173-9.0]
    at org.apache.hadoop.yarn.client.api.impl.AMRMClientImpl.registerApplicationMaster(AMRMClientImpl.java:234) ~[flink-shaded-hadoop-3-uber-3.1.1.7.2.9.0-173-9.0.jar:3.1.1.7.2.9.0-173-9.0]
    at org.apache.hadoop.yarn.client.api.async.impl.AMRMClientAsyncImpl.registerApplicationMaster(AMRMClientAsyncImpl.java:201) ~[flink-shaded-hadoop-3-uber-3.1.1.7.2.9.0-173-9.0.jar:3.1.1.7.2.9.0-173-9.0]
    at org.apache.hadoop.yarn.client.api.async.impl.AMRMClientAsyncImpl.registerApplicationMaster(AMRMClientAsyncImpl.java:180) ~[flink-shaded-hadoop-3-uber-3.1.1.7.2.9.0-173-9.0.jar:3.1.1.7.2.9.0-173-9.0]
    at org.apache.flink.yarn.YarnResourceManagerDriver.registerApplicationMaster(YarnResourceManagerDriver.java:525) ~[chunjun-restore-mysql.jar:?]
    at org.apache.flink.yarn.YarnResourceManagerDriver.initializeInternal(YarnResourceManagerDriver.java:186) ~[chunjun-restore-mysql.jar:?]
    at org.apache.flink.runtime.resourcemanager.active.AbstractResourceManagerDriver.initialize(AbstractResourceManagerDriver.java:92) ~[chunjun-restore-mysql.jar:?]
    at org.apache.flink.runtime.resourcemanager.active.ActiveResourceManager.initialize(ActiveResourceManager.java:171) ~[chunjun-restore-mysql.jar:?]
    at org.apache.flink.runtime.resourcemanager.ResourceManager.startResourceManagerServices(ResourceManager.java:269) ~[chunjun-restore-mysql.jar:?]
    at org.apache.flink.runtime.resourcemanager.ResourceManager.onStart(ResourceManager.java:241) ~[chunjun-restore-mysql.jar:?]
    ... 24 more
    2023-08-14 19:24:49,418 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Shutting YarnSessionClusterEntrypoint down with application status UNKNOWN. Diagnostics Cluster entrypoint has been closed externally..
    2023-08-14 19:24:49,419 INFO org.apache.flink.runtime.blob.BlobServer [] - Stopped BLOB server at 0.0.0.0:41499
    2023-08-14 19:24:49,426 INFO org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint [] - Shutting down rest endpoint.
    2023-08-14 19:24:49,445 INFO org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint [] - Removing cache directory /tmp/flink-web-df56aad0-24ac-49a5-9243-6caff067b1e0/flink-web-ui
    2023-08-14 19:24:49,446 INFO org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint [] - http://10.4.24.251:8082 lost leadership
    2023-08-14 19:24:49,447 INFO org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint [] - Shut down complete.
    2023-08-14 19:24:49,447 INFO org.apache.flink.runtime.entrypoint.component.DispatcherResourceManagerComponent [] - Closing components.
    2023-08-14 19:24:49,447 INFO org.apache.flink.runtime.dispatcher.runner.DefaultDispatcherRunner [] - DefaultDispatcherRunner was revoked the leadership with leader id 00000000-0000-0000-0000-000000000000. Stopping the DispatcherLeaderProcess.
    2023-08-14 19:24:49,448 INFO org.apache.flink.runtime.dispatcher.runner.SessionDispatcherLeaderProcess [] - Stopping SessionDispatcherLeaderProcess.
    2023-08-14 19:24:49,449 INFO org.apache.flink.runtime.resourcemanager.ResourceManagerServiceImpl [] - Stopping resource manager service.
    2023-08-14 19:24:49,450 INFO org.apache.flink.runtime.resourcemanager.ResourceManagerServiceImpl [] - Resource manager service is not running. Ignore revoking leadership.
    2023-08-14 19:24:49,451 INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher [] - Stopping dispatcher akka.tcp://flink@master:36669/user/rpc/dispatcher_0.
    2023-08-14 19:24:49,451 INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher [] - Stopping all currently running jobs of dispatcher akka.tcp://flink@master:36669/user/rpc/dispatcher_0.
    2023-08-14 19:24:49,453 INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher [] - Stopped dispatcher akka.tcp://flink@master:36669/user/rpc/dispatcher_0.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    questionFurther information is requested

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions