Skip to content

Commit 88b578f

Browse files
authored
Merge branch 'main' into mpich
2 parents 559fd2a + d1c6107 commit 88b578f

File tree

2 files changed

+7
-3
lines changed

2 files changed

+7
-3
lines changed

docs/guides/storage.md

Lines changed: 6 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -111,7 +111,7 @@ To set up a default so all newly created folders and dirs inside or your desired
111111
```
112112

113113
!!! info
114-
For more information read the `setfacl` man page: `man setfacl`.
114+
For more information read the `setfacl` man page: [`man setfacl`](https://linux.die.net/man/1/setfacl).
115115

116116
[](){#ref-guides-storage-lustre}
117117
## Lustre tuning
@@ -127,14 +127,18 @@ The data itself is subdivided in blocks of size `<blocksize>` and is stored by O
127127
The block size and number of OSTs to use is defined by the striping settings, which are applied to a path, with new files and directories inheriting them from their parent directory.
128128
The `lfs getstripe <path>` command can be used to get information on the stripe settings of a path.
129129
For directories and empty files `lfs setstripe --stripe-count <count> --stripe-size <size> <directory/file>` can be used to set the layout.
130-
The simplest way to have the correct layout is to copy to a directory with the correct layout
130+
131+
Striping settings on a directory are only applied to files added after the command is run.
132+
Existing files retain their original layout unless explicitly changed using `lfs migrate <striping settings>`, which takes the same arguments as `lfs setstripe`.
133+
The simplest way to have the correct layout is to copy to a directory with the correct layout.
131134

132135
!!! tip "A block size of 4MB gives good throughput, without being overly big..."
133136
... so it is a good choice when reading a file sequentially or in large chunks, but if one reads shorter chunks in random order it might be better to reduce the size, the performance will be smaller, but the performance of your application might actually increase.
134137
See the [Lustre documentation](https://doc.lustre.org/lustre_manual.xhtml#managingstripingfreespace) for more information.
135138

136139

137140
!!! example "Settings for large files"
141+
*Remember:* Settings only apply to files added to the directory after this command.
138142
```console
139143
lfs setstripe --stripe-count -1 --stripe-size 4M <big_files_dir>`
140144
```

docs/platforms/mlp/index.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -51,7 +51,7 @@ Scratch filesystems provide temporary storage for high-performance I/O for execu
5151
Use scratch to store datasets that will be accessed by jobs, and for job output.
5252
Scratch is per user - each user gets separate scratch path and quota.
5353

54-
* The environment variable `SCRATCH=/iopsstor/scratch/cscs/$USER` is set automatically when you log into the system, and can be used as a shortcut to access scratch.
54+
* The environment variable `SCRATCH=/iopsstor/scratch/cscs/$USER` is set automatically when you log into a system of the ML platform, and can be used as a shortcut to access scratch.
5555
* There is an additional scratch path mounted on [Capstor][ref-alps-capstor] at `/capstor/scratch/cscs/$USER`.
5656

5757
!!! warning "scratch cleanup policy"

0 commit comments

Comments
 (0)