-
Notifications
You must be signed in to change notification settings - Fork 1.3k
Description
Search before asking
- I had searched in the issues and found no similar issues.
What happened
Click to start the session cluster Exception。
Logs is
[dinky] 2025-05-06 11:02:40 CST INFO org.apache.flink.configuration.GlobalConfiguration 160 lambda$logConfiguration$0 - Loading configuration property: taskmanager.memory.process.size, 1728m
[dinky] 2025-05-06 11:02:40 CST INFO org.apache.flink.configuration.GlobalConfiguration 160 lambda$logConfiguration$0 - Loading configuration property: taskmanager.bind-host, localhost
[dinky] 2025-05-06 11:02:40 CST INFO org.apache.flink.configuration.GlobalConfiguration 160 lambda$logConfiguration$0 - Loading configuration property: jobmanager.execution.failover-strategy, region
[dinky] 2025-05-06 11:02:40 CST INFO org.apache.flink.configuration.GlobalConfiguration 160 lambda$logConfiguration$0 - Loading configuration property: jobmanager.rpc.address, localhost
[dinky] 2025-05-06 11:02:40 CST INFO org.apache.flink.configuration.GlobalConfiguration 160 lambda$logConfiguration$0 - Loading configuration property: jobmanager.memory.process.size, 1600m
[dinky] 2025-05-06 11:02:40 CST INFO org.apache.flink.configuration.GlobalConfiguration 160 lambda$logConfiguration$0 - Loading configuration property: jobmanager.rpc.port, 6123
[dinky] 2025-05-06 11:02:40 CST INFO org.apache.flink.configuration.GlobalConfiguration 160 lambda$logConfiguration$0 - Loading configuration property: rest.bind-address, 0.0.0.0
[dinky] 2025-05-06 11:02:40 CST INFO org.apache.flink.configuration.GlobalConfiguration 160 lambda$logConfiguration$0 - Loading configuration property: jobmanager.bind-host, localhost
[dinky] 2025-05-06 11:02:40 CST INFO org.apache.flink.configuration.GlobalConfiguration 160 lambda$logConfiguration$0 - Loading configuration property: taskmanager.host, localhost
[dinky] 2025-05-06 11:02:40 CST INFO org.apache.flink.configuration.GlobalConfiguration 160 lambda$logConfiguration$0 - Loading configuration property: parallelism.default, 1
[dinky] 2025-05-06 11:02:40 CST INFO org.apache.flink.configuration.GlobalConfiguration 160 lambda$logConfiguration$0 - Loading configuration property: taskmanager.numberOfTaskSlots, 1
[dinky] 2025-05-06 11:02:40 CST INFO org.apache.flink.configuration.GlobalConfiguration 160 lambda$logConfiguration$0 - Loading configuration property: rest.address, 0.0.0.0
[dinky] 2025-05-06 11:02:40 CST INFO org.apache.flink.configuration.GlobalConfiguration 160 lambda$logConfiguration$0 - Loading configuration property: env.java.opts.all, --add-exports=java.base/sun.net.util=ALL-UNNAMED --add-exports=java.rmi/sun.rmi.registry=ALL-UNNAMED --add-exports=jdk.compiler/com.sun.tools.javac.api=ALL-UNNAMED --add-exports=jdk.compiler/com.sun.tools.javac.file=ALL-UNNAMED --add-exports=jdk.compiler/com.sun.tools.javac.parser=ALL-UNNAMED --add-exports=jdk.compiler/com.sun.tools.javac.tree=ALL-UNNAMED --add-exports=jdk.compiler/com.sun.tools.javac.util=ALL-UNNAMED --add-exports=java.security.jgss/sun.security.krb5=ALL-UNNAMED --add-opens=java.base/java.lang=ALL-UNNAMED --add-opens=java.base/java.net=ALL-UNNAMED --add-opens=java.base/java.io=ALL-UNNAMED --add-opens=java.base/java.nio=ALL-UNNAMED --add-opens=java.base/sun.nio.ch=ALL-UNNAMED --add-opens=java.base/java.lang.reflect=ALL-UNNAMED --add-opens=java.base/java.text=ALL-UNNAMED --add-opens=java.base/java.time=ALL-UNNAMED --add-opens=java.base/java.util=ALL-UNNAMED --add-opens=java.base/java.util.concurrent=ALL-UNNAMED --add-opens=java.base/java.util.concurrent.atomic=ALL-UNNAMED --add-opens=java.base/java.util.concurrent.locks=ALL-UNNAMED
[dinky] 2025-05-06 11:02:40 CST WARN org.apache.flink.yarn.configuration.YarnLogConfigUtil 73 discoverLogConfigFile - The configuration directory ('/application/flink-1.18.1/conf') already contains a LOG4J config file.If you want to use logback, then please delete or rename the log configuration file.
[dinky] 2025-05-06 11:02:40 CST INFO org.apache.hadoop.yarn.client.RMProxy 133 newProxyInstance - Connecting to ResourceManager at /10.7.0.91:8032
[dinky] 2025-05-06 11:02:40 CST INFO org.apache.flink.yarn.YarnClusterDescriptor 223 getLocalFlinkDistPath - No path for the flink jar passed. Using the location of class org.apache.flink.yarn.YarnClusterDescriptor to locate the jar
[dinky] 2025-05-06 11:02:40 CST INFO org.apache.flink.yarn.YarnClusterDescriptor 696 logIfComponentMemNotIntegerMultipleOfYarnMinAllocation - The configured JobManager memory is 1600 MB. YARN will allocate 2048 MB to make up an integer multiple of its minimum allocation memory (1024 MB, configured via 'yarn.scheduler.minimum-allocation-mb'). The extra 448 MB may not be used by Flink.
[dinky] 2025-05-06 11:02:40 CST INFO org.apache.flink.yarn.YarnClusterDescriptor 696 logIfComponentMemNotIntegerMultipleOfYarnMinAllocation - The configured TaskManager memory is 1728 MB. YARN will allocate 2048 MB to make up an integer multiple of its minimum allocation memory (1024 MB, configured via 'yarn.scheduler.minimum-allocation-mb'). The extra 320 MB may not be used by Flink.
[dinky] 2025-05-06 11:02:40 CST INFO org.apache.flink.yarn.YarnClusterDescriptor 583 deployInternal - Cluster specification: ClusterSpecification{masterMemoryMB=1600, taskManagerMemoryMB=1728, slotsPerTaskManager=1}
[dinky] 2025-05-06 11:02:40 CST WARN org.apache.flink.core.plugin.PluginConfig 69 getPluginsDir - The plugins directory [plugins] does not exist.
[dinky] 2025-05-06 11:02:41 CST INFO org.apache.flink.yarn.YarnClusterDescriptor 1179 lambda$removeLocalhostBindHostSetting$9 - Removing 'localhost' Key: 'jobmanager.bind-host' , default: null (fallback keys: []) setting from effective configuration; using '0.0.0.0' instead.
[dinky] 2025-05-06 11:02:41 CST INFO org.apache.flink.yarn.YarnClusterDescriptor 1179 lambda$removeLocalhostBindHostSetting$9 - Removing 'localhost' Key: 'taskmanager.bind-host' , default: null (fallback keys: []) setting from effective configuration; using '0.0.0.0' instead.
[dinky] 2025-05-06 11:02:41 CST INFO org.apache.flink.runtime.util.config.memory.ProcessMemoryUtils 330 capToMinMax - The derived from fraction jvm overhead memory (160.000mb (167772162 bytes)) is less than its min value 192.000mb (201326592 bytes), min value will be used instead
[dinky] 2025-05-06 11:02:41 CST INFO org.apache.flink.yarn.YarnClusterDescriptor 1054 startAppMaster - Cannot use kerberos delegation token manager, no valid kerberos credentials provided.
[dinky] 2025-05-06 11:02:41 CST INFO org.apache.flink.yarn.YarnClusterDescriptor 1118 startAppMaster - Submitting application master application_1746444342319_0034
[dinky] 2025-05-06 11:02:41 CST INFO org.apache.hadoop.yarn.client.api.impl.YarnClientImpl 348 submitApplication - Submitted application application_1746444342319_0034
[dinky] 2025-05-06 11:02:41 CST INFO org.apache.flink.yarn.YarnClusterDescriptor 1121 startAppMaster - Waiting for the cluster to be allocated
[dinky] 2025-05-06 11:02:41 CST INFO org.apache.flink.yarn.YarnClusterDescriptor 1156 startAppMaster - Deploying cluster, current state ACCEPTED
[dinky] 2025-05-06 11:02:43 CST ERROR org.dinky.aop.exception.UnKnownExceptionHandler 39 unknownException - org.apache.flink.client.deployment.ClusterDeploymentException: Couldn't deploy Yarn session cluster java.lang.RuntimeException: org.apache.flink.client.deployment.ClusterDeploymentException: Couldn't deploy Yarn session cluster
at org.dinky.gateway.yarn.YarnSessionGateway.deployCluster(YarnSessionGateway.java:65) ~[dinky-gateway-1.2.3.jar:?]
at org.dinky.job.JobManager.deploySessionCluster(JobManager.java:389) ~[dinky-core-1.2.3.jar:?]
at org.dinky.service.impl.ClusterInstanceServiceImpl.deploySessionCluster(ClusterInstanceServiceImpl.java:234) ~[dinky-admin-1.2.3.jar:?]
at org.dinky.service.impl.ClusterInstanceServiceImpl$$FastClassBySpringCGLIB$$b1f0defa.invoke() ~[dinky-admin-1.2.3.jar:?]
at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) ~[spring-core-5.3.31.jar:5.3.31]
at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) ~[spring-aop-5.3.31.jar:5.3.31]
at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) ~[spring-aop-5.3.31.jar:5.3.31]
at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:703) ~[spring-aop-5.3.31.jar:5.3.31]
at org.dinky.service.impl.ClusterInstanceServiceImpl$$EnhancerBySpringCGLIB$$da2879ce.deploySessionCluster() ~[dinky-admin-1.2.3.jar:?]
at org.dinky.controller.ClusterInstanceController.deploySessionClusterInstance(ClusterInstanceController.java:240) ~[dinky-admin-1.2.3.jar:?]
at org.dinky.controller.ClusterInstanceController$$FastClassBySpringCGLIB$$a81c9eda.invoke() ~[dinky-admin-1.2.3.jar:?]
at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) ~[spring-core-5.3.31.jar:5.3.31]
at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:792) ~[spring-aop-5.3.31.jar:5.3.31]
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) ~[spring-aop-5.3.31.jar:5.3.31]
at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:762) ~[spring-aop-5.3.31.jar:5.3.31]
at org.springframework.aop.framework.adapter.AfterReturningAdviceInterceptor.invoke(AfterReturningAdviceInterceptor.java:57) ~[spring-aop-5.3.31.jar:5.3.31]
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) ~[spring-aop-5.3.31.jar:5.3.31]
at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:762) ~[spring-aop-5.3.31.jar:5.3.31]
at org.springframework.aop.aspectj.AspectJAfterThrowingAdvice.invoke(AspectJAfterThrowingAdvice.java:64) ~[spring-aop-5.3.31.jar:5.3.31]
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:175) ~[spring-aop-5.3.31.jar:5.3.31]
at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:762) ~[spring-aop-5.3.31.jar:5.3.31]
at org.springframework.aop.framework.adapter.AfterReturningAdviceInterceptor.invoke(AfterReturningAdviceInterceptor.java:57) ~[spring-aop-5.3.31.jar:5.3.31]
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:175) ~[spring-aop-5.3.31.jar:5.3.31]
at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:762) ~[spring-aop-5.3.31.jar:5.3.31]
at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) ~[spring-aop-5.3.31.jar:5.3.31]
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) ~[spring-aop-5.3.31.jar:5.3.31]
at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:762) ~[spring-aop-5.3.31.jar:5.3.31]
at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:707) ~[spring-aop-5.3.31.jar:5.3.31]
at org.dinky.controller.ClusterInstanceController$$EnhancerBySpringCGLIB$$445aa6a7.deploySessionClusterInstance() ~[dinky-admin-1.2.3.jar:?]
at jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:?]
at jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77) ~[?:?]
at jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:?]
at java.lang.reflect.Method.invoke(Method.java:568) ~[?:?]
at org.springframework.web.method.support.InvocableHandlerMethod.doInvoke(InvocableHandlerMethod.java:205) ~[spring-web-5.3.31.jar:5.3.31]
at org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:150) ~[spring-web-5.3.31.jar:5.3.31]
at org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAndHandle(ServletInvocableHandlerMethod.java:117) ~[spring-webmvc-5.3.31.jar:5.3.31]
at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.invokeHandlerMethod(RequestMappingHandlerAdapter.java:895) ~[spring-webmvc-5.3.31.jar:5.3.31]
at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.handleInternal(RequestMappingHandlerAdapter.java:808) ~[spring-webmvc-5.3.31.jar:5.3.31]
at org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter.handle(AbstractHandlerMethodAdapter.java:87) ~[spring-webmvc-5.3.31.jar:5.3.31]
at org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:1072) ~[spring-webmvc-5.3.31.jar:5.3.31]
at org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:965) ~[spring-webmvc-5.3.31.jar:5.3.31]
at org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:1006) ~[spring-webmvc-5.3.31.jar:5.3.31]
at org.springframework.web.servlet.FrameworkServlet.doPut(FrameworkServlet.java:920) ~[spring-webmvc-5.3.31.jar:5.3.31]
at javax.servlet.http.HttpServlet.service(HttpServlet.java:520) ~[jakarta.servlet-api-4.0.4.jar:4.0.4]
at org.springframework.web.servlet.FrameworkServlet.service(FrameworkServlet.java:883) ~[spring-webmvc-5.3.31.jar:5.3.31]
at javax.servlet.http.HttpServlet.service(HttpServlet.java:584) ~[jakarta.servlet-api-4.0.4.jar:4.0.4]
at io.undertow.servlet.handlers.ServletHandler.handleRequest(ServletHandler.java:74) ~[undertow-servlet-2.2.28.Final.jar:2.2.28.Final]
at io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:129) ~[undertow-servlet-2.2.28.Final.jar:2.2.28.Final]
at io.undertow.websockets.jsr.JsrWebSocketFilter.doFilter(JsrWebSocketFilter.java:173) ~[undertow-websockets-jsr-2.2.28.Final.jar:2.2.28.Final]
at io.undertow.servlet.core.ManagedFilter.doFilter(ManagedFilter.java:67) ~[undertow-servlet-2.2.28.Final.jar:2.2.28.Final]
at io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:131) ~[undertow-servlet-2.2.28.Final.jar:2.2.28.Final]
at org.springframework.web.filter.CorsFilter.doFilterInternal(CorsFilter.java:91) ~[spring-web-5.3.31.jar:5.3.31]
at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) ~[spring-web-5.3.31.jar:5.3.31]
at io.undertow.servlet.core.ManagedFilter.doFilter(ManagedFilter.java:67) ~[undertow-servlet-2.2.28.Final.jar:2.2.28.Final]
at io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:131) ~[undertow-servlet-2.2.28.Final.jar:2.2.28.Final]
at com.alibaba.druid.support.http.WebStatFilter.doFilter(WebStatFilter.java:114) ~[druid-1.2.23.jar:?]
at io.undertow.servlet.core.ManagedFilter.doFilter(ManagedFilter.java:67) ~[undertow-servlet-2.2.28.Final.jar:2.2.28.Final]
at io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:131) ~[undertow-servlet-2.2.28.Final.jar:2.2.28.Final]
at org.springframework.web.filter.RequestContextFilter.doFilterInternal(RequestContextFilter.java:100) ~[spring-web-5.3.31.jar:5.3.31]
at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) ~[spring-web-5.3.31.jar:5.3.31]
at io.undertow.servlet.core.ManagedFilter.doFilter(ManagedFilter.java:67) ~[undertow-servlet-2.2.28.Final.jar:2.2.28.Final]
at io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:131) ~[undertow-servlet-2.2.28.Final.jar:2.2.28.Final]
at cn.dev33.satoken.filter.SaPathCheckFilterForServlet.doFilter(SaPathCheckFilterForServlet.java:55) ~[sa-token-spring-boot-starter-1.37.0.jar:?]
at io.undertow.servlet.core.ManagedFilter.doFilter(ManagedFilter.java:67) ~[undertow-servlet-2.2.28.Final.jar:2.2.28.Final]
at io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:131) ~[undertow-servlet-2.2.28.Final.jar:2.2.28.Final]
at org.springframework.web.filter.FormContentFilter.doFilterInternal(FormContentFilter.java:93) ~[spring-web-5.3.31.jar:5.3.31]
at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) ~[spring-web-5.3.31.jar:5.3.31]
at io.undertow.servlet.core.ManagedFilter.doFilter(ManagedFilter.java:67) ~[undertow-servlet-2.2.28.Final.jar:2.2.28.Final]
at io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:131) ~[undertow-servlet-2.2.28.Final.jar:2.2.28.Final]
at org.springframework.boot.actuate.metrics.web.servlet.WebMvcMetricsFilter.doFilterInternal(WebMvcMetricsFilter.java:96) ~[spring-boot-actuator-2.7.18.jar:2.7.18]
at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) ~[spring-web-5.3.31.jar:5.3.31]
at io.undertow.servlet.core.ManagedFilter.doFilter(ManagedFilter.java:67) ~[undertow-servlet-2.2.28.Final.jar:2.2.28.Final]
at io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:131) ~[undertow-servlet-2.2.28.Final.jar:2.2.28.Final]
at org.springframework.web.filter.CharacterEncodingFilter.doFilterInternal(CharacterEncodingFilter.java:201) ~[spring-web-5.3.31.jar:5.3.31]
at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) ~[spring-web-5.3.31.jar:5.3.31]
at io.undertow.servlet.core.ManagedFilter.doFilter(ManagedFilter.java:67) ~[undertow-servlet-2.2.28.Final.jar:2.2.28.Final]
at io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:131) ~[undertow-servlet-2.2.28.Final.jar:2.2.28.Final]
at io.undertow.servlet.handlers.FilterHandler.handleRequest(FilterHandler.java:84) ~[undertow-servlet-2.2.28.Final.jar:2.2.28.Final]
at io.undertow.servlet.handlers.security.ServletSecurityRoleHandler.handleRequest(ServletSecurityRoleHandler.java:62) ~[undertow-servlet-2.2.28.Final.jar:2.2.28.Final]
at io.undertow.servlet.handlers.ServletChain$1.handleRequest(ServletChain.java:68) ~[undertow-servlet-2.2.28.Final.jar:2.2.28.Final]
at io.undertow.servlet.handlers.ServletDispatchingHandler.handleRequest(ServletDispatchingHandler.java:36) ~[undertow-servlet-2.2.28.Final.jar:2.2.28.Final]
at io.undertow.servlet.handlers.RedirectDirHandler.handleRequest(RedirectDirHandler.java:68) ~[undertow-servlet-2.2.28.Final.jar:2.2.28.Final]
at io.undertow.servlet.handlers.security.SSLInformationAssociationHandler.handleRequest(SSLInformationAssociationHandler.java:117) ~[undertow-servlet-2.2.28.Final.jar:2.2.28.Final]
at io.undertow.servlet.handlers.security.ServletAuthenticationCallHandler.handleRequest(ServletAuthenticationCallHandler.java:57) ~[undertow-servlet-2.2.28.Final.jar:2.2.28.Final]
at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) ~[undertow-core-2.2.28.Final.jar:2.2.28.Final]
at io.undertow.security.handlers.AbstractConfidentialityHandler.handleRequest(AbstractConfidentialityHandler.java:46) ~[undertow-core-2.2.28.Final.jar:2.2.28.Final]
at io.undertow.servlet.handlers.security.ServletConfidentialityConstraintHandler.handleRequest(ServletConfidentialityConstraintHandler.java:64) ~[undertow-servlet-2.2.28.Final.jar:2.2.28.Final]
at io.undertow.security.handlers.AuthenticationMechanismsHandler.handleRequest(AuthenticationMechanismsHandler.java:60) ~[undertow-core-2.2.28.Final.jar:2.2.28.Final]
at io.undertow.servlet.handlers.security.CachedAuthenticatedSessionHandler.handleRequest(CachedAuthenticatedSessionHandler.java:77) ~[undertow-servlet-2.2.28.Final.jar:2.2.28.Final]
at io.undertow.security.handlers.AbstractSecurityContextAssociationHandler.handleRequest(AbstractSecurityContextAssociationHandler.java:43) ~[undertow-core-2.2.28.Final.jar:2.2.28.Final]
at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) ~[undertow-core-2.2.28.Final.jar:2.2.28.Final]
at io.undertow.servlet.handlers.SendErrorPageHandler.handleRequest(SendErrorPageHandler.java:52) ~[undertow-servlet-2.2.28.Final.jar:2.2.28.Final]
at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) ~[undertow-core-2.2.28.Final.jar:2.2.28.Final]
at io.undertow.servlet.handlers.ServletInitialHandler.handleFirstRequest(ServletInitialHandler.java:275) ~[undertow-servlet-2.2.28.Final.jar:2.2.28.Final]
at io.undertow.servlet.handlers.ServletInitialHandler.access$100(ServletInitialHandler.java:79) ~[undertow-servlet-2.2.28.Final.jar:2.2.28.Final]
at io.undertow.servlet.handlers.ServletInitialHandler$2.call(ServletInitialHandler.java:134) ~[undertow-servlet-2.2.28.Final.jar:2.2.28.Final]
at io.undertow.servlet.handlers.ServletInitialHandler$2.call(ServletInitialHandler.java:131) ~[undertow-servlet-2.2.28.Final.jar:2.2.28.Final]
at io.undertow.servlet.core.ServletRequestContextThreadSetupAction$1.call(ServletRequestContextThreadSetupAction.java:48) ~[undertow-servlet-2.2.28.Final.jar:2.2.28.Final]
at io.undertow.servlet.core.ContextClassLoaderSetupAction$1.call(ContextClassLoaderSetupAction.java:43) ~[undertow-servlet-2.2.28.Final.jar:2.2.28.Final]
at io.undertow.servlet.handlers.ServletInitialHandler.dispatchRequest(ServletInitialHandler.java:255) ~[undertow-servlet-2.2.28.Final.jar:2.2.28.Final]
at io.undertow.servlet.handlers.ServletInitialHandler.access$000(ServletInitialHandler.java:79) ~[undertow-servlet-2.2.28.Final.jar:2.2.28.Final]
at io.undertow.servlet.handlers.ServletInitialHandler$1$1.run(ServletInitialHandler.java:106) ~[undertow-servlet-2.2.28.Final.jar:2.2.28.Final]
at java.security.AccessController.doPrivileged(AccessController.java:569) ~[?:?]
at io.undertow.servlet.handlers.ServletInitialHandler$1.handleRequest(ServletInitialHandler.java:103) ~[undertow-servlet-2.2.28.Final.jar:2.2.28.Final]
at io.undertow.server.Connectors.executeRootHandler(Connectors.java:393) ~[undertow-core-2.2.28.Final.jar:2.2.28.Final]
at io.undertow.server.HttpServerExchange$1.run(HttpServerExchange.java:852) ~[undertow-core-2.2.28.Final.jar:2.2.28.Final]
at org.jboss.threads.ContextClassLoaderSavingRunnable.run(ContextClassLoaderSavingRunnable.java:35) ~[jboss-threads-3.1.0.Final.jar:3.1.0.Final]
at org.jboss.threads.EnhancedQueueExecutor.safeRun(EnhancedQueueExecutor.java:2019) ~[jboss-threads-3.1.0.Final.jar:3.1.0.Final]
at org.jboss.threads.EnhancedQueueExecutor$ThreadBody.doRunTask(EnhancedQueueExecutor.java:1558) ~[jboss-threads-3.1.0.Final.jar:3.1.0.Final]
at org.jboss.threads.EnhancedQueueExecutor$ThreadBody.run(EnhancedQueueExecutor.java:1449) ~[jboss-threads-3.1.0.Final.jar:3.1.0.Final]
at org.xnio.XnioWorker$WorkerThreadFactory$1$1.run(XnioWorker.java:1282) ~[xnio-api-3.8.7.Final.jar:3.8.7.Final]
at java.lang.Thread.run(Thread.java:833) ~[?:?]
Caused by: org.apache.flink.client.deployment.ClusterDeploymentException: Couldn't deploy Yarn session cluster
at org.apache.flink.yarn.YarnClusterDescriptor.deploySessionCluster(YarnClusterDescriptor.java:426) ~[dinky-client-1.18-1.2.3.jar:1.18.1]
at org.dinky.gateway.yarn.YarnSessionGateway.deployCluster(YarnSessionGateway.java:57) ~[dinky-gateway-1.2.3.jar:?]
... 111 more
Caused by: org.apache.flink.yarn.YarnClusterDescriptor$YarnDeploymentException: The YARN application unexpectedly switched to state FAILED during deployment.
Diagnostics from YARN: Application application_1746444342319_0034 failed 1 times (global limit =2; local limit is =1) due to AM Container for appattempt_1746444342319_0034_000001 exited with exitCode: 1
Failing this attempt.Diagnostics: [2025-05-06 11:02:43.495]Exception from container-launch.
Container id: container_1746444342319_0034_01_000001
Exit code: 1
[2025-05-06 11:02:43.498]Container exited with a non-zero exit code 1. Error file: prelaunch.err.
Last 4096 bytes of prelaunch.err :
[2025-05-06 11:02:43.499]Container exited with a non-zero exit code 1. Error file: prelaunch.err.
Last 4096 bytes of prelaunch.err :
For more detailed output, check the application tracking page: http://hadoop-master:8088/cluster/app/application_1746444342319_0034 Then click on links to logs of each attempt.
. Failing the application.
If log aggregation is enabled on your cluster, use this command to further investigate the issue:
yarn logs -applicationId application_1746444342319_0034
at org.apache.flink.yarn.YarnClusterDescriptor.startAppMaster(YarnClusterDescriptor.java:1142) ~[dinky-client-1.18-1.2.3.jar:1.18.1]
at org.apache.flink.yarn.YarnClusterDescriptor.deployInternal(YarnClusterDescriptor.java:590) ~[dinky-client-1.18-1.2.3.jar:1.18.1]
at org.apache.flink.yarn.YarnClusterDescriptor.deploySessionCluster(YarnClusterDescriptor.java:423) ~[dinky-client-1.18-1.2.3.jar:1.18.1]
at org.dinky.gateway.yarn.YarnSessionGateway.deployCluster(YarnSessionGateway.java:57) ~[dinky-gateway-1.2.3.jar:?]
... 111 more
flink-yarn.conf
################################################################################
Licensed to the Apache Software Foundation (ASF) under one
or more contributor license agreements. See the NOTICE file
distributed with this work for additional information
regarding copyright ownership. The ASF licenses this file
to you under the Apache License, Version 2.0 (the
"License"); you may not use this file except in compliance
with the License. You may obtain a copy of the License at
http://www.apache.org/licenses/LICENSE-2.0
Unless required by applicable law or agreed to in writing, software
distributed under the License is distributed on an "AS IS" BASIS,
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
See the License for the specific language governing permissions and
limitations under the License.
################################################################################
These parameters are required for Java 17 support.
They can be safely removed when using Java 8/11.
env.java.opts.all: --add-exports=java.base/sun.net.util=ALL-UNNAMED --add-exports=java.rmi/sun.rmi.registry=ALL-UNNAMED --add-exports=jdk.compiler/com.sun.tools.javac.api=ALL-UNNAMED --add-exports=jdk.compiler/com.sun.tools.javac.file=ALL-UNNAMED --add-exports=jdk.compiler/com.sun.tools.javac.parser=ALL-UNNAMED --add-exports=jdk.compiler/com.sun.tools.javac.tree=ALL-UNNAMED --add-exports=jdk.compiler/com.sun.tools.javac.util=ALL-UNNAMED --add-exports=java.security.jgss/sun.security.krb5=ALL-UNNAMED --add-opens=java.base/java.lang=ALL-UNNAMED --add-opens=java.base/java.net=ALL-UNNAMED --add-opens=java.base/java.io=ALL-UNNAMED --add-opens=java.base/java.nio=ALL-UNNAMED --add-opens=java.base/sun.nio.ch=ALL-UNNAMED --add-opens=java.base/java.lang.reflect=ALL-UNNAMED --add-opens=java.base/java.text=ALL-UNNAMED --add-opens=java.base/java.time=ALL-UNNAMED --add-opens=java.base/java.util=ALL-UNNAMED --add-opens=java.base/java.util.concurrent=ALL-UNNAMED --add-opens=java.base/java.util.concurrent.atomic=ALL-UNNAMED --add-opens=java.base/java.util.concurrent.locks=ALL-UNNAMED
#==============================================================================
Common
#==============================================================================
The external address of the host on which the JobManager runs and can be
reached by the TaskManagers and any clients which want to connect. This setting
is only used in Standalone mode and may be overwritten on the JobManager side
by specifying the --host parameter of the bin/jobmanager.sh executable.
In high availability mode, if you use the bin/start-cluster.sh script and setup
the conf/masters file, this will be taken care of automatically. Yarn
automatically configure the host name based on the hostname of the node where the
JobManager runs.
jobmanager.rpc.address: localhost
The RPC port where the JobManager is reachable.
jobmanager.rpc.port: 6123
The host interface the JobManager will bind to. By default, this is localhost, and will prevent
the JobManager from communicating outside the machine/container it is running on.
On YARN this setting will be ignored if it is set to 'localhost', defaulting to 0.0.0.0.
On Kubernetes this setting will be ignored, defaulting to 0.0.0.0.
To enable this, set the bind-host address to one that has access to an outside facing network
interface, such as 0.0.0.0.
jobmanager.bind-host: localhost
The total process memory size for the JobManager.
Note this accounts for all memory usage within the JobManager process, including JVM metaspace and other overhead.
jobmanager.memory.process.size: 1600m
The host interface the TaskManager will bind to. By default, this is localhost, and will prevent
the TaskManager from communicating outside the machine/container it is running on.
On YARN this setting will be ignored if it is set to 'localhost', defaulting to 0.0.0.0.
On Kubernetes this setting will be ignored, defaulting to 0.0.0.0.
To enable this, set the bind-host address to one that has access to an outside facing network
interface, such as 0.0.0.0.
taskmanager.bind-host: localhost
The address of the host on which the TaskManager runs and can be reached by the JobManager and
other TaskManagers. If not specified, the TaskManager will try different strategies to identify
the address.
Note this address needs to be reachable by the JobManager and forward traffic to one of
the interfaces the TaskManager is bound to (see 'taskmanager.bind-host').
Note also that unless all TaskManagers are running on the same machine, this address needs to be
configured separately for each TaskManager.
taskmanager.host: localhost
The total process memory size for the TaskManager.
Note this accounts for all memory usage within the TaskManager process, including JVM metaspace and other overhead.
taskmanager.memory.process.size: 1728m
To exclude JVM metaspace and overhead, please, use total Flink memory size instead of 'taskmanager.memory.process.size'.
It is not recommended to set both 'taskmanager.memory.process.size' and Flink memory.
taskmanager.memory.flink.size: 1280m
The number of task slots that each TaskManager offers. Each slot runs one parallel pipeline.
taskmanager.numberOfTaskSlots: 1
The parallelism used for programs that did not specify and other parallelism.
parallelism.default: 1
The default file system scheme and authority.
By default file paths without scheme are interpreted relative to the local
root file system 'file:///'. Use this to override the default and interpret
relative paths relative to a different file system,
for example 'hdfs://mynamenode:12345'
fs.default-scheme
#==============================================================================
High Availability
#==============================================================================
The high-availability mode. Possible options are 'NONE' or 'zookeeper'.
high-availability.type: zookeeper
The path where metadata for master recovery is persisted. While ZooKeeper stores
the small ground truth for checkpoint and leader election, this location stores
the larger objects, like persisted dataflow graphs.
Must be a durable file system that is accessible from all nodes
(like HDFS, S3, Ceph, nfs, ...)
high-availability.storageDir: hdfs:///flink/ha/
The list of ZooKeeper quorum peers that coordinate the high-availability
setup. This must be a list of the form:
"host1:clientPort,host2:clientPort,..." (default clientPort: 2181)
high-availability.zookeeper.quorum: localhost:2181
ACL options are based on https://zookeeper.apache.org/doc/r3.1.2/zookeeperProgrammers.html#sc_BuiltinACLSchemes
It can be either "creator" (ZOO_CREATE_ALL_ACL) or "open" (ZOO_OPEN_ACL_UNSAFE)
The default value is "open" and it can be changed to "creator" if ZK security is enabled
high-availability.zookeeper.client.acl: open
#==============================================================================
Fault tolerance and checkpointing
#==============================================================================
The backend that will be used to store operator state checkpoints if
checkpointing is enabled. Checkpointing is enabled when execution.checkpointing.interval > 0.
Execution checkpointing related parameters. Please refer to CheckpointConfig and ExecutionCheckpointingOptions for more details.
execution.checkpointing.interval: 3min
execution.checkpointing.externalized-checkpoint-retention: [DELETE_ON_CANCELLATION, RETAIN_ON_CANCELLATION]
execution.checkpointing.max-concurrent-checkpoints: 1
execution.checkpointing.min-pause: 0
execution.checkpointing.mode: [EXACTLY_ONCE, AT_LEAST_ONCE]
execution.checkpointing.timeout: 10min
execution.checkpointing.tolerable-failed-checkpoints: 0
execution.checkpointing.unaligned: false
Supported backends are 'hashmap', 'rocksdb', or the
.
state.backend.type: hashmap
Directory for checkpoints filesystem, when using any of the default bundled
state backends.
state.checkpoints.dir: hdfs://namenode-host:port/flink-checkpoints
Default target directory for savepoints, optional.
state.savepoints.dir: hdfs://namenode-host:port/flink-savepoints
Flag to enable/disable incremental checkpoints for backends that
support incremental checkpoints (like the RocksDB state backend).
state.backend.incremental: false
The failover strategy, i.e., how the job computation recovers from task failures.
Only restart tasks that may have been affected by the task failure, which typically includes
downstream tasks and potentially upstream tasks if their produced data is no longer available for consumption.
jobmanager.execution.failover-strategy: region
#==============================================================================
Rest & web frontend
#==============================================================================
The port to which the REST client connects to. If rest.bind-port has
not been specified, then the server will bind to this port as well.
#rest.port: 8081
The address to which the REST client will connect to
rest.address: 0.0.0.0
Port range for the REST and web server to bind to.
#rest.bind-port: 8080-8090
The address that the REST & web server binds to
By default, this is localhost, which prevents the REST & web server from
being able to communicate outside of the machine/container it is running on.
To enable this, set the bind address to one that has access to outside-facing
network interface, such as 0.0.0.0.
rest.bind-address: 0.0.0.0
Flag to specify whether job submission is enabled from the web-based
runtime monitor. Uncomment to disable.
#web.submit.enable: false
Flag to specify whether job cancellation is enabled from the web-based
runtime monitor. Uncomment to disable.
#web.cancel.enable: false
#==============================================================================
Advanced
#==============================================================================
Override the directories for temporary files. If not specified, the
system-specific Java temporary directory (java.io.tmpdir property) is taken.
For framework setups on Yarn, Flink will automatically pick up the
containers' temp directories without any need for configuration.
Add a delimited list for multiple directories, using the system directory
delimiter (colon ':' on unix) or a comma, e.g.:
/data1/tmp:/data2/tmp:/data3/tmp
Note: Each directory entry is read from and written to by a different I/O
thread. You can include the same directory multiple times in order to create
multiple I/O threads against that directory. This is for example relevant for
high-throughput RAIDs.
io.tmp.dirs: /tmp
The classloading resolve order. Possible values are 'child-first' (Flink's default)
and 'parent-first' (Java's default).
Child first classloading allows users to use different dependency/library
versions in their application than those in the classpath. Switching back
to 'parent-first' may help with debugging dependency issues.
classloader.resolve-order: child-first
The amount of memory going to the network stack. These numbers usually need
no tuning. Adjusting them may be necessary in case of an "Insufficient number
of network buffers" error. The default min is 64MB, the default max is 1GB.
taskmanager.memory.network.fraction: 0.1
taskmanager.memory.network.min: 64mb
taskmanager.memory.network.max: 1gb
#==============================================================================
Flink Cluster Security Configuration
#==============================================================================
Kerberos authentication for various components - Hadoop, ZooKeeper, and connectors -
may be enabled in four steps:
1. configure the local krb5.conf file
2. provide Kerberos credentials (either a keytab or a ticket cache w/ kinit)
3. make the credentials available to various JAAS login contexts
4. configure the connector to use JAAS/SASL
The below configure how Kerberos credentials are provided. A keytab will be used instead of
a ticket cache if the keytab path and principal are set.
security.kerberos.login.use-ticket-cache: true
security.kerberos.login.keytab: /path/to/kerberos/keytab
security.kerberos.login.principal: flink-user
The configuration below defines which JAAS login contexts
security.kerberos.login.contexts: Client,KafkaClient
#==============================================================================
ZK Security Configuration
#==============================================================================
Below configurations are applicable if ZK ensemble is configured for security
Override below configuration to provide custom ZK service name if configured
zookeeper.sasl.service-name: zookeeper
The configuration below must match one of the values set in "security.kerberos.login.contexts"
zookeeper.sasl.login-context-name: Client
#==============================================================================
HistoryServer
#==============================================================================
The HistoryServer is started and stopped via bin/historyserver.sh (start|stop)
Directory to upload completed jobs to. Add this directory to the list of
monitored directories of the HistoryServer as well (see below).
#jobmanager.archive.fs.dir: hdfs:///completed-jobs/
The address under which the web-based HistoryServer listens.
#historyserver.web.address: 0.0.0.0
The port under which the web-based HistoryServer listens.
#historyserver.web.port: 8082
Comma separated list of directories to monitor for completed jobs.
#historyserver.archive.fs.dir: hdfs:///completed-jobs/
Interval in milliseconds for refreshing the monitored directories.
#historyserver.archive.fs.refresh-interval: 10000
What you expected to happen
I want return json data,success is true
How to reproduce
Anything else
No response
Version
1.2.3
Are you willing to submit PR?
- Yes I am willing to submit a PR!
Code of Conduct
- I agree to follow this project's Code of Conduct
