[Bug] Skywalking OAP pod not ready

[xucq07]

Search before asking

• I had searched in the issues and found no similar issues.

Apache SkyWalking Component

Helm Chart (apache/skywalking-helm)

What happened

First, I installed it using helm install skywalking oci://registry-1.docker.io/apache/skywalking-helm --version 4.7.0 -n skywalking -f sky.yaml.

Then I saw that the init job ran normally, and the index templates and indexes in Elasticsearch were created normally.

Then Skywalking OAP started two pods. One pod ran normally, but the readiness check of the other pod kept failing.

I tried to check the logs of the pod that failed to start, and only the following output was found.

'''
[Entrypoint] Apache SkyWalking Docker Image

• exec java -Dmode=no-init -Xmx2g -Xms2g -classpath '/skywalking/ext-libs/*.jar:oap-libs/zstd-jni-1.5.2-1.jar:oap-libs/zookeeper-jute-3.5.7.jar:oap-libs/zookeeper-3.5.7.jar:oap-libs/zjsonpatch-0.3.0.jar:oap-libs/zipkin-receiver-plugin-10.3.0.jar:oap-libs/zipkin-query-plugin-10.3.0.jar:oap-libs/zipkin-2.24.1.jar:oap-libs/vavr-match-0.10.3.jar:oap-libs/vavr-0.10.3.jar:oap-libs/tool-profile-snapshot-server-mock-10.3.0.jar:oap-libs/tool-profile-snapshot-exporter-10.3.0.jar:oap-libs/tool-profile-snapshot-bootstrap-10.3.0.jar:oap-libs/telemetry-prometheus-10.3.0.jar:oap-libs/telemetry-api-10.3.0.jar:oap-libs/storage-jdbc-hikaricp-plugin-10.3.0.jar:oap-libs/storage-elasticsearch-plugin-10.3.0.jar:oap-libs/storage-banyandb-plugin-10.3.0.jar:oap-libs/status-query-plugin-10.3.0.jar:oap-libs/snappy-java-1.1.8.4.jar:oap-libs/snakeyaml-engine-2.6.jar:oap-libs/snakeyaml-2.0.jar:oap-libs/slf4j-api-1.7.30.jar:oap-libs/skywalking-zabbix-receiver-plugin-10.3.0.jar:oap-libs/skywalking-trace-receiver-plugin-10.3.0.jar:oap-libs/skywalking-telegraf-receiver-plugin-10.3.0.jar:oap-libs/skywalking-sharing-server-plugin-10.3.0.jar:oap-libs/skywalking-profile-receiver-plugin-10.3.0.jar:oap-libs/skywalking-pprof-receiver-plugin-10.3.0.jar:oap-libs/skywalking-meter-receiver-plugin-10.3.0.jar:oap-libs/skywalking-mesh-receiver-plugin-10.3.0.jar:oap-libs/skywalking-management-receiver-plugin-10.3.0.jar:oap-libs/skywalking-log-receiver-plugin-10.3.0.jar:oap-libs/skywalking-jvm-receiver-plugin-10.3.0.jar:oap-libs/skywalking-event-receiver-plugin-10.3.0.jar:oap-libs/skywalking-ebpf-receiver-plugin-10.3.0.jar:oap-libs/skywalking-clr-receiver-plugin-10.3.0.jar:oap-libs/skywalking-browser-receiver-plugin-10.3.0.jar:oap-libs/skywalking-async-profiler-receiver-plugin-10.3.0.jar:oap-libs/simpleclient_hotspot-0.6.0.jar:oap-libs/simpleclient_common-0.6.0.jar:oap-libs/simpleclient-0.6.0.jar:oap-libs/service-1.18.0.jar:oap-libs/server-testing-10.3.0.jar:oap-libs/server-starter-10.3.0.jar:oap-libs/server-health-checker-10.3.0.jar:oap-libs/server-core-10.3.0.jar:oap-libs/server-alarm-plugin-10.3.0.jar:oap-libs/retrofit-2.9.0.jar:oap-libs/receiver-proto-10.3.0.jar:oap-libs/reactive-streams-1.0.3.jar:oap-libs/re2j-1.7.jar:oap-libs/query-graphql-plugin-10.3.0.jar:oap-libs/proto-google-common-protos-2.48.0.jar:oap-libs/protobuf-java-util-3.25.5.jar:oap-libs/protobuf-java-3.25.5.jar:oap-libs/protobuf-jackson-2.7.0.jar:oap-libs/promql-plugin-10.3.0.jar:oap-libs/postgresql-42.4.4.jar:oap-libs/pgv-java-stub-1.2.1.jar:oap-libs/perfmark-api-0.27.0.jar:oap-libs/otel-receiver-plugin-10.3.0.jar:oap-libs/okio-1.17.2.jar:oap-libs/okhttp-3.14.9.jar:oap-libs/oal-rt-10.3.0.jar:oap-libs/oal-grammar-10.3.0.jar:oap-libs/netty-transport-native-unix-common-4.2.5.Final-osx-x86_64.jar:oap-libs/netty-transport-native-unix-common-4.2.5.Final-osx-aarch_64.jar:oap-libs/netty-transport-native-unix-common-4.2.5.Final-linux-x86_64.jar:oap-libs/netty-transport-native-unix-common-4.2.5.Final-linux-aarch_64.jar:oap-libs/netty-transport-native-unix-common-4.2.5.Final.jar:oap-libs/netty-transport-native-kqueue-4.2.5.Final-osx-x86_64.jar:oap-libs/netty-transport-native-kqueue-4.2.5.Final-osx-aarch_64.jar:oap-libs/netty-transport-native-epoll-4.2.5.Final-linux-x86_64.jar:oap-libs/netty-transport-native-epoll-4.2.5.Final-linux-aarch_64.jar:oap-libs/netty-transport-native-epoll-4.2.5.Final.jar:oap-libs/netty-transport-classes-kqueue-4.2.5.Final.jar:oap-libs/netty-transport-classes-epoll-4.2.5.Final.jar:oap-libs/netty-transport-4.2.5.Final.jar:oap-libs/netty-tcnative-classes-2.0.73.Final.jar:oap-libs/netty-tcnative-boringssl-static-2.0.73.Final-windows-x86_64.jar:oap-libs/netty-tcnative-boringssl-static-2.0.73.Final-osx-x86_64.jar:oap-libs/netty-tcnative-boringssl-static-2.0.73.Final-osx-aarch_64.jar:oap-libs/netty-tcnative-boringssl-static-2.0.73.Final-linux-x86_64.jar:oap-libs/netty-tcnative-boringssl-static-2.0.73.Final-linux-aarch_64.jar:oap-libs/netty-tcnative-boringssl-static-2.0.69.Final.jar:oap-libs/netty-resolver-dns-native-macos-4.2.5.Final-osx-x86_64.jar:oap-libs/netty-resolver-dns-native-macos-4.2.5.Final-osx-aarch_64.jar:oap-libs/netty-resolver-dns-classes-macos-4.2.5.Final.jar:oap-libs/netty-resolver-dns-4.2.5.Final.jar:oap-libs/netty-resolver-4.2.5.Final.jar:oap-libs/netty-handler-proxy-4.2.5.Final.jar:oap-libs/netty-handler-4.2.5.Final.jar:oap-libs/netty-common-4.2.5.Final.jar:oap-libs/netty-codec-socks-4.2.5.Final.jar:oap-libs/netty-codec-protobuf-4.2.5.Final.jar:oap-libs/netty-codec-marshalling-4.2.5.Final.jar:oap-libs/netty-codec-http-4.2.5.Final.jar:oap-libs/netty-codec-http2-4.2.5.Final.jar:oap-libs/netty-codec-haproxy-4.2.5.Final.jar:oap-libs/netty-codec-dns-4.2.5.Final.jar:oap-libs/netty-codec-compression-4.2.5.Final.jar:oap-libs/netty-codec-base-4.2.5.Final.jar:oap-libs/netty-codec-4.2.5.Final.jar:oap-libs/netty-buffer-4.2.5.Final.jar:oap-libs/nacos-encryption-plugin-2.3.2.jar:oap-libs/nacos-client-2.3.2.jar:oap-libs/nacos-auth-plugin-2.3.2.jar:oap-libs/mqe-rt-10.3.0.jar:oap-libs/mqe-grammar-10.3.0.jar:oap-libs/micrometer-observation-1.14.4.jar:oap-libs/micrometer-core-1.14.4.jar:oap-libs/micrometer-commons-1.14.4.jar:oap-libs/meter-analyzer-10.3.0.jar:oap-libs/lz4-java-1.8.0.jar:oap-libs/logql-plugin-10.3.0.jar:oap-libs/log-analyzer-10.3.0.jar:oap-libs/log4j-slf4j-impl-2.17.1.jar:oap-libs/log4j-over-slf4j-1.7.30.jar:oap-libs/log4j-core-2.17.1.jar:oap-libs/log4j-api-2.17.1.jar:oap-libs/listenablefuture-9999.0-empty-to-avoid-conflict-with-guava.jar:oap-libs/library-util-10.3.0.jar:oap-libs/library-server-10.3.0.jar:oap-libs/library-pprof-parser-10.3.0.jar:oap-libs/library-module-10.3.0.jar:oap-libs/library-kubernetes-support-10.3.0.jar:oap-libs/library-elasticsearch-client-10.3.0.jar:oap-libs/library-datacarrier-queue-10.3.0.jar:oap-libs/library-client-10.3.0.jar:oap-libs/library-async-profiler-jfr-parser-10.3.0.jar:oap-libs/LatencyUtils-2.0.3.jar:oap-libs/kubernetes-model-storageclass-6.7.1.jar:oap-libs/kubernetes-model-scheduling-6.7.1.jar:oap-libs/kubernetes-model-resource-6.7.1.jar:oap-libs/kubernetes-model-rbac-6.7.1.jar:oap-libs/kubernetes-model-policy-6.7.1.jar:oap-libs/kubernetes-model-node-6.7.1.jar:oap-libs/kubernetes-model-networking-6.7.1.jar:oap-libs/kubernetes-model-metrics-6.7.1.jar:oap-libs/kubernetes-model-gatewayapi-6.7.1.jar:oap-libs/kubernetes-model-flowcontrol-6.7.1.jar:oap-libs/kubernetes-model-extensions-6.7.1.jar:oap-libs/kubernetes-model-events-6.7.1.jar:oap-libs/kubernetes-model-discovery-6.7.1.jar:oap-libs/kubernetes-model-core-6.7.1.jar:oap-libs/kubernetes-model-coordination-6.7.1.jar:oap-libs/kubernetes-model-common-6.7.1.jar:oap-libs/kubernetes-model-certificates-6.7.1.jar:oap-libs/kubernetes-model-batch-6.7.1.jar:oap-libs/kubernetes-model-autoscaling-6.7.1.jar:oap-libs/kubernetes-model-apps-6.7.1.jar:oap-libs/kubernetes-model-apiextensions-6.7.1.jar:oap-libs/kubernetes-model-admissionregistration-6.7.1.jar:oap-libs/kubernetes-httpclient-jdk-6.7.1.jar:oap-libs/kubernetes-client-api-6.7.1.jar:oap-libs/kubernetes-client-6.7.1.jar:oap-libs/kotlinx-coroutines-reactive-1.6.4.jar:oap-libs/kotlinx-coroutines-jdk8-1.6.4.jar:oap-libs/kotlinx-coroutines-core-jvm-1.6.4.jar:oap-libs/kotlinx-coroutines-core-1.6.4.jar:oap-libs/kotlin-stdlib-jdk8-1.6.21.jar:oap-libs/kotlin-stdlib-jdk7-1.6.21.jar:oap-libs/kotlin-stdlib-common-1.7.10.jar:oap-libs/kotlin-stdlib-1.7.10.jar:oap-libs/kotlin-reflect-1.7.10.jar:oap-libs/kafka-fetcher-plugin-10.3.0.jar:oap-libs/kafka-clients-3.4.0.jar:oap-libs/jsr305-3.0.2.jar:oap-libs/joda-time-2.10.5.jar:oap-libs/jetcd-grpc-0.6.1.jar:oap-libs/jetcd-core-0.6.1.jar:oap-libs/jetcd-common-0.6.1.jar:oap-libs/jetcd-api-0.6.1.jar:oap-libs/jcl-over-slf4j-1.7.30.jar:oap-libs/javax.inject-1.jar:oap-libs/javassist-3.25.0-GA.jar:oap-libs/java-dataloader-3.2.1.jar:oap-libs/jackson-module-kotlin-2.13.4.jar:oap-libs/jackson-datatype-jsr310-2.18.2.jar:oap-libs/jackson-datatype-jdk8-2.12.0.jar:oap-libs/jackson-datatype-guava-2.12.0.jar:oap-libs/jackson-dataformat-yaml-2.15.2.jar:oap-libs/jackson-databind-2.16.0.jar:oap-libs/jackson-core-2.16.0.jar:oap-libs/jackson-annotations-2.16.0.jar:oap-libs/j2objc-annotations-2.8.jar:oap-libs/istio-model-v1beta1-6.7.1.jar:oap-libs/istio-model-v1alpha3-6.7.1.jar:oap-libs/istio-client-6.7.1.jar:oap-libs/httpcore-nio-4.4.16.jar:oap-libs/httpcore-4.4.16.jar:oap-libs/httpclient-4.5.13.jar:oap-libs/httpasyncclient-4.1.5.jar:oap-libs/HikariCP-3.1.0.jar:oap-libs/HdrHistogram-2.2.2.jar:oap-libs/guice-4.1.0.jar:oap-libs/guava-32.0.1-jre.jar:oap-libs/gson-2.9.0.jar:oap-libs/grpc-util-1.70.0.jar:oap-libs/grpc-stub-1.70.0.jar:oap-libs/grpc-services-1.70.0.jar:oap-libs/grpc-protobuf-lite-1.70.0.jar:oap-libs/grpc-protobuf-1.70.0.jar:oap-libs/grpc-netty-1.70.0.jar:oap-libs/grpc-grpclb-1.70.0.jar:oap-libs/grpc-core-1.70.0.jar:oap-libs/grpc-context-1.70.0.jar:oap-libs/grpc-configuration-sync-10.3.0.jar:oap-libs/grpc-api-1.70.0.jar:oap-libs/groovy-4.0.15.jar:oap-libs/graphql-java-tools-13.0.1.jar:oap-libs/graphql-java-extended-scalars-18.1.jar:oap-libs/graphql-java-21.5.jar:oap-libs/freemarker-2.3.31.jar:oap-libs/flatbuffers-java-1.12.0.jar:oap-libs/fetcher-proto-10.3.0.jar:oap-libs/failureaccess-1.0.1.jar:oap-libs/failsafe-2.4.4.jar:oap-libs/exporter-10.3.0.jar:oap-libs/event-analyzer-10.3.0.jar:oap-libs/error_prone_annotations-2.11.0.jar:oap-libs/envoy-metrics-receiver-plugin-10.3.0.jar:oap-libs/data-generator-10.3.0.jar:oap-libs/curator-x-discovery-4.3.0.jar:oap-libs/curator-recipes-4.3.0.jar:oap-libs/curator-framework-4.3.0.jar:oap-libs/curator-client-4.3.0.jar:oap-libs/converter-jackson-2.9.0.jar:oap-libs/consul-client-1.5.3.jar:oap-libs/configuration-zookeeper-10.3.0.jar:oap-libs/configuration-nacos-10.3.0.jar:oap-libs/configuration-k8s-configmap-10.3.0.jar:oap-libs/configuration-etcd-10.3.0.jar:oap-libs/configuration-discovery-receiver-plugin-10.3.0.jar:oap-libs/configuration-consul-10.3.0.jar:oap-libs/configuration-apollo-10.3.0.jar:oap-libs/configuration-api-10.3.0.jar:oap-libs/commons-validator-1.9.0.jar:oap-libs/commons-text-1.4.jar:oap-libs/commons-net-3.9.0.jar:oap-libs/commons-lang3-3.18.0.jar:oap-libs/commons-io-2.17.0.jar:oap-libs/commons-codec-1.11.jar:oap-libs/commons-beanutils-1.11.0.jar:oap-libs/cluster-zookeeper-plugin-10.3.0.jar:oap-libs/cluster-standalone-plugin-10.3.0.jar:oap-libs/cluster-nacos-plugin-10.3.0.jar:oap-libs/cluster-kubernetes-plugin-10.3.0.jar:oap-libs/cluster-etcd-plugin-10.3.0.jar:oap-libs/cluster-consul-plugin-10.3.0.jar:oap-libs/classmate-1.5.1.jar:oap-libs/cilium-fetcher-plugin-10.3.0.jar:oap-libs/checker-qual-3.33.0.jar:oap-libs/brotli4j-1.18.0.jar:oap-libs/banyandb-java-client-0.9.2.jar:oap-libs/aws-firehose-receiver-10.3.0.jar:oap-libs/auto-service-annotations-1.0.1.jar:oap-libs/audience-annotations-0.5.0.jar:oap-libs/async-profiler-converter-3.0.jar:oap-libs/armeria-protobuf-1.32.0.jar:oap-libs/armeria-grpc-protocol-1.32.0.jar:oap-libs/armeria-grpc-1.32.0.jar:oap-libs/armeria-graphql-protocol-1.32.0.jar:oap-libs/armeria-graphql-1.32.0.jar:oap-libs/armeria-1.32.0.jar:oap-libs/apollo-core-1.8.0.jar:oap-libs/apollo-client-1.8.0.jar:oap-libs/apm-network-10.3.0.jar:oap-libs/aopalliance-1.0.jar:oap-libs/antlr4-runtime-4.11.1.jar:oap-libs/annotations-17.0.0.jar:oap-libs/animal-sniffer-annotations-1.24.jar:oap-libs/ai-pipeline-10.3.0.jar:oap-libs/agent-analyzer-10.3.0.jar:config:' org.apache.skywalking.oap.server.starter.OAPServerStartUp

'''

Kubernetes version: 1.34

What you expected to happen

Sorry, I couldn't find the reason for this problem.

How to reproduce

Install using the following command:

helm install skywalking oci://registry-1.docker.io/apache/skywalking-helm --version 4.7.0 -n skywalking -f sky.yaml

sky.yaml:
oap:
image:
tag: 10.3.0
storageType: elasticsearch
env:
SW_CORE_RECORD_DATA_TTL: "30"
SW_CORE_METRICS_DATA_TTL: "30"

ui:
image:
tag: 10.3.0

elasticsearch:
enabled: false
config:
host: xxxx.xxxx.svc
port:
http: 9200
user: "elastic"
password: "xxxxxxxx"

Anything else

No response

Are you willing to submit a pull request to fix on your own?

• Yes I am willing to submit a pull request on my own!

Code of Conduct

• I agree to follow this project's Code of Conduct