Skip to content

add alps hardware storage first draft #29

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 1 commit into from
Feb 25, 2025
Merged

add alps hardware storage first draft #29

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
35 changes: 29 additions & 6 deletions docs/alps/storage.md
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,14 +1,37 @@
[](){#ref-alps-storage}
# Alps Storage

Alps has different storage attached, each with characteristics suited to different workloads and use cases.
HPC storage is manged in a separate cluster of nodes that host servers that manage the storage and the physical storage drives.
These separate clusters are on the same Slingshot 11 network as the Alps.

| | Capstor | IOPStor | Vast |
|--------------|------------------------|------------------------|---------------------|
| Model | HPE ClusterStor E1000D | HPE ClusterStor E1000F | Vast |
| Type | Lustre | Lustre | NFS |
| Capacity | 129 PB raw GridRAID | 7.2 PB raw RAID 10 | 1 PB |
| Number of Drives | 8,480 16 TB HDD | 240 * 30 TB NVME SSD | N/A |
| Read Speed | 1.19 TB/s | 782 GB/s | 38 GB/s |
| Write Speed | 1.09 TB/s | 393 GB/s | 11 GB/s |
| IOPs | 1.5M | 8.6M read, 24M write | 200k read, 768k write |
| file create/s| 374k | 214k | 97k |

## capstor

Capstor is the largest file system, for storing large amounts of input and output data.
It is used to provide SCRATCH and STORE for different clusters - the precise details are platform-specific.

## iopstor

!!! todo
Document the main storage hardware attached to Alps:
small text explaining what iopstor is designed to be used for.

## vast

* capstor
* iopstor
* vast
The Vast storage is smaller capacity system that is designed for use as home folders.

The focus of these docs would be the basic details.
!!! todo
small text explaining what iopstor is designed to be used for.

The mounts, and how they are used for SCRATCH, STORE, PROJECT, HOME would be in the [storage docs](../storage/index.md)
The mounts, and how they are used for SCRATCH, STORE, PROJECT, HOME would be in the [storage docs][ref-storage-fs]

4 changes: 4 additions & 0 deletions docs/storage/filesystems.md
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,5 +1,9 @@
[](){#ref-storage-fs}
# File Systems

!!! todo
these are already out of date and need significant refactoring to be coherently linked to cluster definitions.

CSCS supports different file systems, whose specifications are summarized in the table below:

| | `$SCRATCH` | `$PROJECT` | `$STORE` | `$HOME` | `$PROJECT_ID` | `$SCRATCH_ID` | `$STORE_ID` |
Expand Down