Skip to content

Volumes to small for XFS storage class #897

@marcusboden

Description

@marcusboden

Bug Description

I tried to deploy this charm on a Canonical K8s using xfs storage class, but two of the PVCs were erroring out:

  Warning  FailedMount             13s (x8 over 80s)  kubelet                  MountVolume.MountDevice failed for volume "pvc-d01813ff-28af-4d67-8a4e-083de939fe27" : rpc error: code = Internal desc = exit status 1
  Warning  FailedMount             13s (x8 over 80s)  kubelet                  MountVolume.MountDevice failed for volume "pvc-33b354d7-4b76-4cde-9833-ef50dafbc26e" : rpc error: code = Internal desc = exit status 1

I traced it down in the csi pods, and found that it cannot format the volumes as XFS, because they are too small:

E0212 07:21:34.730109    3636 nodeserver.go:829] ID: 8064 Req-ID: 0001-0024-4adf1e24-0055-11f1-82d4-530be1c4f8a1-0000000000000002-99b4fe7b-9c72-402e-bffb-bc007c4f88e6 failed to run mkfs.xfs ([-K -m reflink=0 /dev/rbd1]) error: exit status 1, output: size 1280 of data subvolume is too small, minimum 4096 blocks

I increased the size of the vols to 1Gi and then the vault could get scheduled.

To Reproduce

  1. deploy Canonical K8s
  2. deploy vault-k8s

Environment

k8s:

App                      Version          Status  Scale  Charm          Channel         Rev  Exposed  Message
ceph-csi                 v3.13.0,v0,v...  active      3  ceph-csi       1.32/stable      70  no       Versions: cephfs=v3.13.0, config=v0, rbd=v3.13.0
ceph-mon                 19.2.3           active      3  ceph-mon       squid/stable    268  no       Unit is ready and clustered
ceph-osd                 19.2.3           active      3  ceph-osd       squid/stable    632  no       Unit is ready (1 OSD)
grafana-agent-container                   active      3  grafana-agent  1/stable        603  no       tracing: off
grafana-agent-vm                          active      3  grafana-agent  1/stable        603  no       tracing: off
k8s                      1.32.11          active      3  k8s            1.32/stable    1718  no       Ready

Vault:

vault                                     blocked      1  vault-k8s                     1.16/stable    323  10.152.183.161  no       Please initialize Vault or integrate with an auto-unseal provider

Relevant log output

Warning  FailedMount             13s (x8 over 80s)  kubelet                  MountVolume.MountDevice failed for volume "pvc-d01813ff-28af-4d67-8a4e-083de939fe27" : rpc error: code = Internal desc = exit status 1
  Warning  FailedMount             13s (x8 over 80s)  kubelet                  MountVolume.MountDevice failed for volume "pvc-33b354d7-4b76-4cde-9833-ef50dafbc26e" : rpc error: code = Internal desc = exit status 1



E0212 07:21:34.730109    3636 nodeserver.go:829] ID: 8064 Req-ID: 0001-0024-4adf1e24-0055-11f1-82d4-530be1c4f8a1-0000000000000002-99b4fe7b-9c72-402e-bffb-bc007c4f88e6 failed to run mkfs.xfs ([-K -m reflink=0 /dev/rbd1]) error: exit status 1, output: size 1280 of data subvolume is too small, minimum 4096 blocks

Additional context

No response

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't working

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions