Merge branch 'main' into mlp-tutorials-update-iii

Author: lukasgd

docs/guides/gb25.md

@@ -0,0 +1,74 @@
+# Gordon Bell 2025
+
+This is temporary documentation for the Gordon Bell second round benchmark runs scheduled for the week August 18-22 2025.
+
+## Schedule
+
+Times are in CEST (Central European  Time): [Time conversion table](https://time.is/compare/0800_18_Aug_2025_in_CET/PT/ET/Perth)
+
+| group  | date | time  | duration (h) | activity |
+| ---    | ---- | ----- | -----------: | --------------------- |
+| -      | 08-18| 08:00 | -            | Daint is reconfigured and resized for GB runs             |
+| all    | 08-18| ASAP  | -            | Daint is available to all teams for final testing at scale |
+| `g202` | 08-18| 21:00 | 2            | GB run |
+| `g199` | 08-18| 23:00 | 10           | GB run |
+| `g186` | 08-19| 09:00 | 6            | GB run |
+| `g200` | 08-19| 15:00 | 3            | GB run |
+| `g183` | 08-19| 18:00 | 24           | GB run |
+| `cwd01`| 08-20| 18:00 | 5            | GB run |
+| -      | 08-20| 23:00 | 9            | *free slot* |
+| `g188` | 08-21| 08:00 | 8            | GB run |
+
+## System
+
+The system [Daint][ref-cluster-daint] will be expanded to approximately 2350 Grace-Hopper nodes.
+
+* [Grace-Hopper nodes][ref-alps-gh200-node].
+* [using Slurm with Grace-Hopper][ref-slurm-gh200].
+
+!!! todo "information about partition, account, time limits"
+
+```bash
+#!/bin/bash
+
+#SBATCH --account=<group>
+#SBATCH --partition=normal
+#SBATCH --reservation=<group>
+
+srun --uenv=prgenv-gnu/24.11:v2 --view=default -n? -N? ....
+```
+
+## Recommendations on run configuration
+
+### Disabling core-dumps
+
+If a large job crashes and tries to write core-dump files on thousands of processes,
+it will overwhelm the filesystem. Therefore we strongly recommend to disable them with
+the following command:
+
+``` console title="disable writing of core-dump files"
+$ ulimit -S -c0
+```
+
+### Improving job startup times
+
+In the first round of GB runs we identified slow job startup times as a common cause of crashes during job startup.
+
+With HPE we have identified that the most likely cause is file system contention loading dynamic libraries before `main()` starts.
+
+The fix is to update how the SquashFS file for the uenv or container used by your job is stored on the filesystem.
+
+```console title="set lustre striping on uenv squashfs file"
+$ uenv image inspect prgenv-gnu/24.11:v2 --format='{sqfs}'
+/capstor/scratch/cscs/bcumming/.uenv-images/images/6068794b820fb4dd91019d020d6d98334a2f9fd23035a5e4a2f72f9dda5f1260/store.squashfs
+$ lfs migrate --stripe-count 20 --stripe-size 1M $(uenv image inspect prgenv-gnu/24.11:v2 --format='{sqfs}')
+```
+
+If you are using a [SquashFS image for your Python environment][ref-guides-storage-venv],
+you should also set the striping for that file.
+
+As an additional precaution, we recommend to increase the default wait threshold for `MPI_Init` from 180 seconds to 300.
+```console title="increase MPI initialization time-out"
+$ export PMI_MMAP_SYNC_WAIT_TIME=300
+```
+

docs/services/cicd.md

@@ -763,7 +763,7 @@ value: `jfrog.svc.cscs.ch/docker-ci-ext/<repository-id>`
 
 The prefix path in the CSCS internal container image registry, to which your pipeline has write access.
 Within this prefix, you can choose any directory structure.
-Images that are pushed to a path matching **/public/** , can be pulled by anybody within CSCS network
+Images that are pushed to a path matching `**/public/**`, can be pulled by anybody within CSCS network
 
 ### `CSCS_CI_MW_URL`
 value: `https://cicd-ext-mw.cscs.ch/ci`

docs/software/container-engine/edf.md

@@ -168,15 +168,15 @@ Environment variables to set in the container. Empty string values will unset th
      * Basic `env` block
         ```toml
         [env]
-        MY_RUN = "production",
+        MY_RUN = "production"
         DEBUG = "false"
         ```
 
      * Use of environment variable expansion
         ```toml
         [env]
-        MY_NODE = "${VAR_FROM_HOST}",
-        PATH = "${PATH}:/custom/bin", 
+        MY_NODE = "${VAR_FROM_HOST}"
+        PATH = "${PATH}:/custom/bin"
         DEBUG = "true"
         ```
 

mkdocs.yml

@@ -130,6 +130,7 @@ nav:
     - 'Internet Access on Alps': guides/internet-access.md
     - 'Storage': guides/storage.md
     - 'Using the terminal': guides/terminal.md
+    - 'Gordon Bell 2025': guides/gb25.md
   - 'Policies':
     - policies/index.md
     - 'User Regulations': policies/regulations.md