-
Notifications
You must be signed in to change notification settings - Fork 18
Open
Labels
bugSomething isn't workingSomething isn't working
Description
Bug Description
I tried to deploy this charm on a Canonical K8s using xfs storage class, but two of the PVCs were erroring out:
Warning FailedMount 13s (x8 over 80s) kubelet MountVolume.MountDevice failed for volume "pvc-d01813ff-28af-4d67-8a4e-083de939fe27" : rpc error: code = Internal desc = exit status 1
Warning FailedMount 13s (x8 over 80s) kubelet MountVolume.MountDevice failed for volume "pvc-33b354d7-4b76-4cde-9833-ef50dafbc26e" : rpc error: code = Internal desc = exit status 1
I traced it down in the csi pods, and found that it cannot format the volumes as XFS, because they are too small:
E0212 07:21:34.730109 3636 nodeserver.go:829] ID: 8064 Req-ID: 0001-0024-4adf1e24-0055-11f1-82d4-530be1c4f8a1-0000000000000002-99b4fe7b-9c72-402e-bffb-bc007c4f88e6 failed to run mkfs.xfs ([-K -m reflink=0 /dev/rbd1]) error: exit status 1, output: size 1280 of data subvolume is too small, minimum 4096 blocks
I increased the size of the vols to 1Gi and then the vault could get scheduled.
To Reproduce
- deploy Canonical K8s
- deploy vault-k8s
Environment
k8s:
App Version Status Scale Charm Channel Rev Exposed Message
ceph-csi v3.13.0,v0,v... active 3 ceph-csi 1.32/stable 70 no Versions: cephfs=v3.13.0, config=v0, rbd=v3.13.0
ceph-mon 19.2.3 active 3 ceph-mon squid/stable 268 no Unit is ready and clustered
ceph-osd 19.2.3 active 3 ceph-osd squid/stable 632 no Unit is ready (1 OSD)
grafana-agent-container active 3 grafana-agent 1/stable 603 no tracing: off
grafana-agent-vm active 3 grafana-agent 1/stable 603 no tracing: off
k8s 1.32.11 active 3 k8s 1.32/stable 1718 no Ready
Vault:
vault blocked 1 vault-k8s 1.16/stable 323 10.152.183.161 no Please initialize Vault or integrate with an auto-unseal provider
Relevant log output
Warning FailedMount 13s (x8 over 80s) kubelet MountVolume.MountDevice failed for volume "pvc-d01813ff-28af-4d67-8a4e-083de939fe27" : rpc error: code = Internal desc = exit status 1
Warning FailedMount 13s (x8 over 80s) kubelet MountVolume.MountDevice failed for volume "pvc-33b354d7-4b76-4cde-9833-ef50dafbc26e" : rpc error: code = Internal desc = exit status 1
E0212 07:21:34.730109 3636 nodeserver.go:829] ID: 8064 Req-ID: 0001-0024-4adf1e24-0055-11f1-82d4-530be1c4f8a1-0000000000000002-99b4fe7b-9c72-402e-bffb-bc007c4f88e6 failed to run mkfs.xfs ([-K -m reflink=0 /dev/rbd1]) error: exit status 1, output: size 1280 of data subvolume is too small, minimum 4096 blocksAdditional context
No response
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
bugSomething isn't workingSomething isn't working