Skip to content

Commit d36f9f5

Browse files
committed
Update Ceph instructions for Manila integrations
1 parent 858ae01 commit d36f9f5

File tree

3 files changed

+18
-7
lines changed

3 files changed

+18
-7
lines changed

docs/filesystems.md

Lines changed: 13 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -1,6 +1,6 @@
11
# Overview
22

3-
The Slurm appliance supports mounting shared filesystems using [CephFS](https://docs.ceph.com/en/latest/cephfs/) via [OpenStack Manila](https://docs.openstack.org/manila/latest/). These docs explain:
3+
The Slurm appliance supports mounting shared filesystems using [CephFS](https://docs.ceph.com/en/latest/cephfs/) via [OpenStack Manila](https://docs.openstack.org/manila/latest/). This section explains:
44

55
- How to create the shares in OpenStack Manila.
66

@@ -18,7 +18,7 @@ If this is the first time Manila is being used on the system, a CephFS share typ
1818
openstack share type create cephfs-type false --extra-specs storage_protocol=CEPHFS vendor_name=Ceph
1919
```
2020

21-
Once this exists, create a share using credentials for the Slurm project. An access rule also needs to be created, where the `access_to` argument (`openstack share access create <share> <access_type> <access_to>`) is a user that will be created in Ceph. This needs to be globally unique in Ceph, so needs to be different for each OpenStack project.
21+
Once this exists, create a share using credentials for the Slurm project. An access rule also needs to be created, where the `access_to` argument (`openstack share access create <share> <access_type> <access_to>`) is a user that will be created in Ceph. This needs to be globally unique in Ceph, so needs to be different for each OpenStack project. Ideally, this share should include your environment name. In this example, the name is "production".
2222

2323
```bash
2424
openstack share create CephFS 300 --description 'Scratch dir for Slurm prod' --name slurm-production-scratch --share-type cephfs-type --wait
@@ -36,13 +36,23 @@ To mount shares onto hosts in a group, add them to the `manila` group.
3636
compute
3737
```
3838

39-
Set the version of Ceph which is running on the system.
39+
If you are running a different version of Ceph from the defaults in the i[os-manila-mount role](https://github.com/stackhpc/ansible-role-os-manila-mount/blob/master/defaults/main.yml), you will need to update the package version by setting the following.
4040

4141
```yaml
4242
# environments/site/inventory/group_vars/manila.yml:
4343
os_manila_mount_ceph_version: "18.2.4"
4444
```
4545
46+
This will need to be included in the `builder` group to be installed in the host image.
47+
48+
```ini
49+
# environments/site/inventory/groups:
50+
[manila:children]:
51+
login
52+
compute
53+
builder
54+
```
55+
4656
Define the list of shares to be mounted, and the paths to mount them to. The example below parameterises the share name using the environment name. See the [stackhpc.os-manila-mount role](https://github.com/stackhpc/ansible-role-os-manila-mount) for further configuration options.
4757

4858
```yaml

environments/common/inventory/group_vars/all/manila.yml

Lines changed: 5 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -10,4 +10,8 @@ os_manila_mount_shares: []
1010
# mount_group:
1111
# mount_mode:
1212

13-
# os_manila_mount_ceph_version: nautilus # role default for RockyLinux 8
13+
# os_manila_mount_ceph_version:
14+
15+
# Empty repo lists from stackhpc.ansible-role-os-manila-mount role defaults, as these repofiles are
16+
# now generated by dnf_repos to allow injecting Ark creds:
17+
os_manila_mount_ceph_rpm_repos: []

environments/common/inventory/group_vars/all/os-manila-mount.yml

Lines changed: 0 additions & 3 deletions
This file was deleted.

0 commit comments

Comments
 (0)