draft gb docs

Author: bcumming

docs/guides/gb25.md

@@ -0,0 +1,48 @@
+# Gordon Bell 2025
+
+This is temporary documentation for the Gordon Bell second round benchmark runs scheduled for the week August 18-22 2025.
+
+## Schedule
+
+| group | date | time | activity |
+| ---   | ---- | ----- | --------------------- |
+| -     | 08-15| 08:00 | Daint is reconfigured and resized for GB runs             |
+| all   | 08-15| ASAP  | Daint is available to all teams for final testing at scale |
+| `g???`| 08-15| 18:00 | Daint is available to all teams for final testing at scale |
+
+## System
+
+The system [Daint][ref-cluster-daint] will be expanded to approximately 2350 Grace-Hopper nodes.
+
+* [Grace-Hopper nodes][ref-alps-gh200-node].
+* [using Slurm with Grace-Hopper][ref-slurm-gh200].
+
+!!! todo "information about partition, account, time limits"
+
+```bash
+#!/bin/bash
+
+#SBATCH --account=<account>
+#SBATCH --partition=<todo>
+
+srun --uenv=prgenv-gnu/24.11:v2 --view=default -n? -N? ....
+```
+
+## Tips
+
+### Improving job startup times
+
+In the first round of GB runs we identified slow job startup times as a common cause of crashes during job startup.
+
+With HPE we have identified that the most likely cause is file system contention loading dynamic libraries before `main()` starts.
+
+The fix is to update how the squashfs file for the uenv or container used by your job is stored on the filesystem.
+
+```console title="set lustre striping on uenv squashfs file"
+$ uenv image inspect prgenv-gnu/24.11:v2 --format='{sqfs}'
+/capstor/scratch/cscs/bcumming/.uenv-images/images/6068794b820fb4dd91019d020d6d98334a2f9fd23035a5e4a2f72f9dda5f1260/store.squashfs
+$ lfs setstripe --stripe-count -1 --stripe-size 4M $(uenv image inspect prgenv-gnu/24.11:v2 --format='{sqfs}')
+```
+
+!!! todo "update this with the final guidance"
+

mkdocs.yml

@@ -129,6 +129,7 @@ nav:
       - 'LLM Inference': guides/mlp_tutorials/llm-inference.md
       - 'LLM Fine-tuning': guides/mlp_tutorials/llm-fine-tuning.md
       - 'LLM Pre-training': guides/mlp_tutorials/llm-nanotron-training.md
+    - 'Gordon Bell 2025': guides/gb25.md
   - 'Policies':
     - policies/index.md
     - 'User Regulations': policies/regulations.md