Add microceph

[sed-i]

For deployments like COS that need S3, it could be handy if concierge was able to install ceph and set up radosgw.
Here's a reference we're currently using:

microceph:
  # Ref: https://canonical-microceph.readthedocs-hosted.com/en/latest/tutorial/get-started/
  sudo snap install microceph
  sudo snap refresh --hold microceph
  sudo microceph cluster bootstrap
  sudo microceph disk add loop,4G,3
  sudo ceph status

  # Ref: https://canonical-microceph.readthedocs-hosted.com/en/latest/reference/commands/enable/#rgw
  # (Traefik will take ports 80, 443)
  sudo microceph enable rgw --port 8080 --ssl-port 8443
  sudo microceph.ceph -s
  sudo microceph.radosgw-admin user create --uid=user --display-name=User
  sudo microceph.radosgw-admin key create --uid=user --key-type=s3 --access-key=access-key --secret-key=secret-key

  sudo apt install -y s3cmd
  # Now you can create buckets with:
  # s3cmd --host=localhost:8080 --access_key=access-key --secret_key=secret-key --host-bucket= --no-ssl mb s3://loki

[benhoyt]

@sed-i Thanks for the feature request. Do you think this should be part of a preset, or just an option you can enable?

[sed-i]

Good question. I don't have a straight answer :)

• Are presets additive? I.e. can I tell concierge -p microceph -p k8s?
• Currently it seems like all the presets will end up using hostpath-storage. When concierge installs microceph, it should also add ceph-csi as a storage class to (micro)k8s.
• If COS is the only thing currently requesting this, what's your policy on adding a preset such as "cos"?

[benhoyt]

1. No, presets aren't additive: concierge prepare -p microceph -p k8s would give you the last one, k8s.
2. Got it.
3. I think that's probably reasonable. We could either add "cos" or something more specific like "microk8s-cos".

[jnsgruk]

Or perhaps, more generally, microk8s-ceph and k8s-ceph?

[benhoyt]

Yeah, I like microk8s-ceph and k8s-ceph. @sed-i Would you or someone on your team be interested in creating a PR on a rainy day?

[sed-i]

We'll be discussing internally how to best approach the topic in general.
A possible outcome is indeed a PR to concierge. Will update.

[dimaqq]

@sed-i let's clarify the scope.

• is it for testing COS itself, or
• is it for folks integration-testing their charms against COS?