-
Notifications
You must be signed in to change notification settings - Fork 130
Open
Description
Attempting to do a vary basic install of SigNoz on a 3 node kubernetes cluster.
Steps to Reproduce
- Install SigNoz with basic Helm values (to use LoadBalancer port 80)
- Check running pods
Environment
- Kubernetes version: v1.33.4+k0s
- Helm chart version: 0.93.1
- Installation method: Helm
- Storage Class: ceph-rbd
Expected Behavior
All pods should be running.
Actual Behavior
The signoz pod goes into CrashLoopBackOff.
Helm Values Used
global:
storageClass: ceph-rbd
clickhouse:
installCustomStorageClass: true
signoz:
replicaCount: 3
service:
annotations:
metallb.universe.tf/loadBalancerIPs: "192.168.6.177" # Your desired IP
type: LoadBalancer
port: 80
otelCollector:
service:
type: LoadBalancer
loadBalancerIP: "192.168.6.175"Logs from signoz-0 pod.
% kubectl logs signoz-0 -n signoz
Defaulted container "signoz" out of: signoz, signoz-init (init)
-**********=
.::-=+**********+=--:.
.-=*******++=-----==+******=-.
:-+*******=:. :-+******=:
.-********+: .=*******=.
{"timestamp":"2025-09-28T16:47:09.734634544Z","level":"WARN","code":{"function":"github.com/SigNoz/signoz/pkg/signoz.mergeAndEnsureBackwardCompatibility","file":"/home/runner/work/signoz/signoz/pkg/signoz/config.go","line":243},"msg":"[Deprecated] flag --config is deprecated for passing prometheus config. The flag will be used for passing the entire SigNoz config. More details can be found at https://github.com/SigNoz/signoz/issues/6805."}
{"timestamp":"2025-09-28T16:47:09.734726709Z","level":"WARN","code":{"function":"github.com/SigNoz/signoz/pkg/signoz.mergeAndEnsureBackwardCompatibility","file":"/home/runner/work/signoz/signoz/pkg/signoz/config.go","line":295},"msg":"[Deprecated] flag --flux-interval is deprecated and scheduled for removal. Please use SIGNOZ_QUERIER_FLUX__INTERVAL instead."}
{"timestamp":"2025-09-28T16:47:09.73474347Z","level":"WARN","code":{"function":"github.com/SigNoz/signoz/pkg/signoz.mergeAndEnsureBackwardCompatibility","file":"/home/runner/work/signoz/signoz/pkg/signoz/config.go","line":305},"msg":"[Deprecated] flag --flux-interval-for-trace-detail is deprecated and scheduled for complete removal. Please use SIGNOZ_QUERIER_FLUX__INTERVAL instead."}
{"timestamp":"2025-09-28T16:47:09.734755368Z","level":"WARN","code":{"function":"github.com/SigNoz/signoz/pkg/signoz.mergeAndEnsureBackwardCompatibility","file":"/home/runner/work/signoz/signoz/pkg/signoz/config.go","line":309},"msg":"[Deprecated] flag --cluster is deprecated and scheduled for removal. Please use SIGNOZ_TELEMETRYSTORE_CLICKHOUSE_CLUSTER instead."}
{"timestamp":"2025-09-28T16:47:09.73486034Z","level":"ERROR","code":{"function":"github.com/SigNoz/signoz/cmd.NewJWTSecret","file":"/home/runner/work/signoz/signoz/cmd/config.go","line":37},"msg":"🚨 CRITICAL SECURITY ISSUE: No JWT secret key specified!","error":"SIGNOZ_JWT_SECRET environment variable is not set. This has dire consequences for the security of the application. Without a JWT secret, user sessions are vulnerable to tampering and unauthorized access. Please set the SIGNOZ_JWT_SECRET environment variable immediately. For more information, please refer to https://github.com/SigNoz/signoz/issues/8400."}
:+********+: .=*******+:
.+*********+ :+***+. -********+:
-**********+. .****= =*********= ____ _ _ _ ____ _ _ _
.************: +**** +**********: / ___|| |_ __ _ _ __| |_(_)_ __ __ _ / ___|(_) __ _| \ | | ___ ____
.************+ .----: -***********- \___ \| __/ _` | '__| __| | '_ \ / _` | \___ \| |/ _` | \| |/ _ \_ /
*************= :************. ___) | || (_| | | | |_| | | | | (_| | ___) | | (_| | |\ | (_) / / _ _ _
:************+ ----: -***********= |____/ \__\__,_|_| \__|_|_| |_|\__, | |____/|_|\__, |_| \_|\___/___(_|_|_)
:************. ***** +**********: |___/ |___/
.=**********+ :****= -*********+. Version: v0.96.1 (enterprise) [Copyright 2025 SigNoz, All rights reserved]
:+*********+ :+***+ -********+:
:+********+. =*******+-
:=********=. -*******=:
:=*******+-. .-+******=-.
:-+*******+=--:::--=+******+=:
.:-==+***********+=-::
:**********=
{"timestamp":"2025-09-28T16:47:09.735612993Z","level":"INFO","code":{"function":"github.com/SigNoz/signoz/pkg/signoz.New","file":"/home/runner/work/signoz/signoz/pkg/signoz/signoz.go","line":75},"msg":"starting signoz","version":"v0.96.1","variant":"enterprise","commit":"2c19f01","branch":"v0.96.1","go":"go1.24.7","timestamp":"2025-09-25T15:18:31Z"}
{"timestamp":"2025-09-28T16:47:09.735815398Z","level":"INFO","code":{"function":"github.com/SigNoz/signoz/pkg/sqlstore/sqlitesqlstore.New","file":"/home/runner/work/signoz/signoz/pkg/sqlstore/sqlitesqlstore/provider.go","line":44},"msg":"connected to sqlite","logger":"github.com/SigNoz/signoz/pkg/sqlitesqlstore","path":"/var/lib/signoz/signoz.db"}
{"timestamp":"2025-09-28T16:47:09.741769837Z","level":"ERROR","code":{"function":"github.com/prometheus/prometheus/promql.NewActiveQueryTracker","file":"/home/runner/go/pkg/mod/github.com/prometheus/prometheus@v0.304.1/promql/query_logger.go","line":137},"msg":"Failed to create directory for logging active queries","logger":"github.com/SigNoz/signoz/pkg/prometheus/clickhouseprometheus"}
{"timestamp":"2025-09-28T16:47:09.769082207Z","level":"INFO","code":{"function":"github.com/SigNoz/signoz/pkg/sqlmigrator.(*migrator).Migrate","file":"/home/runner/work/signoz/signoz/pkg/sqlmigrator/migrator.go","line":44},"msg":"starting sqlstore migrations","logger":"github.com/SigNoz/signoz/pkg/sqlmigrator","dialect":"sqlite"}
{"timestamp":"2025-09-28T16:47:09.851851869Z","level":"INFO","code":{"function":"github.com/SigNoz/signoz/pkg/sqlmigrator.(*migrator).Lock","file":"/home/runner/work/signoz/signoz/pkg/sqlmigrator/migrator.go","line":91},"msg":"acquired migration lock","logger":"github.com/SigNoz/signoz/pkg/sqlmigrator","dialect":"sqlite"}
{"timestamp":"2025-09-28T16:47:09.852553863Z","level":"INFO","code":{"function":"github.com/SigNoz/signoz/pkg/sqlmigrator.(*migrator).Migrate","file":"/home/runner/work/signoz/signoz/pkg/sqlmigrator/migrator.go","line":61},"msg":"no new migrations to run (database is up to date)","logger":"github.com/SigNoz/signoz/pkg/sqlmigrator","dialect":"sqlite"}
{"level":"info","timestamp":"2025-09-28T16:47:14.932Z","caller":"app/server.go:367","msg":"rules manager is ready"}
{"level":"info","timestamp":"2025-09-28T16:47:14.939Z","caller":"app/server.go:257","msg":"Query server started listening on 0.0.0.0:8080..."}
{"timestamp":"2025-09-28T16:47:14.940021808Z","level":"INFO","code":{"function":"github.com/SigNoz/signoz/pkg/factory.(*Registry).Start.func1","file":"/home/runner/work/signoz/signoz/pkg/factory/registry.go","line":50},"msg":"starting service","pkg":"go.signoz.io/pkg/factory","service":"analytics"}
{"level":"info","timestamp":"2025-09-28T16:47:14.940Z","caller":"app/server.go:277","msg":"Starting HTTP server","port":8080,"addr":"0.0.0.0:8080"}
{"level":"info","timestamp":"2025-09-28T16:47:14.940Z","caller":"app/server.go:289","msg":"Starting pprof server","addr":"0.0.0.0:6060"}
{"level":"info","timestamp":"2025-09-28T16:47:14.940Z","caller":"app/server.go:298","msg":"Starting OpAmp Websocket server","addr":"0.0.0.0:4320"}
{"timestamp":"2025-09-28T16:47:14.940507647Z","level":"INFO","code":{"function":"github.com/SigNoz/signoz/pkg/factory.(*Registry).Start.func1","file":"/home/runner/work/signoz/signoz/pkg/factory/registry.go","line":50},"msg":"starting service","pkg":"go.signoz.io/pkg/factory","service":"licensing"}
{"timestamp":"2025-09-28T16:47:14.940602624Z","level":"INFO","code":{"function":"github.com/SigNoz/signoz/pkg/factory.(*Registry).Start.func1","file":"/home/runner/work/signoz/signoz/pkg/factory/registry.go","line":50},"msg":"starting service","pkg":"go.signoz.io/pkg/factory","service":"instrumentation"}
{"timestamp":"2025-09-28T16:47:14.940651121Z","level":"INFO","code":{"function":"github.com/SigNoz/signoz/pkg/factory.(*Registry).Start.func1","file":"/home/runner/work/signoz/signoz/pkg/factory/registry.go","line":50},"msg":"starting service","pkg":"go.signoz.io/pkg/factory","service":"alertmanager"}
{"timestamp":"2025-09-28T16:47:14.940752613Z","level":"INFO","code":{"function":"github.com/SigNoz/signoz/pkg/factory.(*Registry).Start.func1","file":"/home/runner/work/signoz/signoz/pkg/factory/registry.go","line":50},"msg":"starting service","pkg":"go.signoz.io/pkg/factory","service":"statsreporter"}
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
No labels