@@ -10,13 +10,6 @@ project <http://sci.aalto.fi/en/research/muu_tutkimustoiminta/science-it/>`__,
1010which was founded in 2009 to facilitate the HPC Infrastructure in all of
1111School of Science. It is now available to all Aalto researchers.
1212
13- As of 2016, Triton is part of `FGCI - Finnish Grid and Cloud
14- Infrastructure <https://www.csc.fi/-/fgci> `__ (predecessor of `Finnish
15- Grid
16- Infrastructure <http://www.csc.fi/tutkimus/Laskentapalvelut/gridymparisto/fgi> `__).
17- Through the national grid and cloud infrastructure, Triton also becomes
18- part of the European Grid Infrastructure.
19-
2013Hardware
2114--------
2215
@@ -30,37 +23,30 @@ ip-address.
3023Networking
3124----------
3225
33- The cluster has two internal networks: Infiniband for MPI and Lustre
34- filesystem and Gigabit Ethernet for everything else like NFS ``/home ``
35- directories and ssh.
26+ Internally the cluster uses Infiniband for MPI and Lustre and NFS.
3627
3728The internal networks are unaccessible from outside. Only the login node
3829``triton.aalto.fi `` has an extra Ethernet connection to outside.
3930
4031High performance InfiniBand has fat-tree configuration in general. Triton
4132has several InfiniBand segments (often called islands) distinguished based
42- on the CPU arch. The nodes within those islands connected with different
43- ratio like 2:1, 4:1 or 8:1, (i.e. in 4:1 case for each 4
44- downlinks there is 1 uplink to spine switches. The islands are
45- ``ivb[1-45] `` 540 cores, ``pe[3-91] `` 2152 cores
46- (keep in mind that ``pe[83-91] `` have 28 cores per node), four ``c[xxx-xxx] `` segments
47- with 600 cores each, skl[1-48] and csl[1-48] with 1920 cores each [CHECKME]. Uplinks from
33+ on the CPU arch. Uplinks from
4834those islands are mainly used for Lustre communication.
4935Running MPI jobs possible on the entire island or its segment, but not
5036across the cluster.
5137
52- Disk arrays
53- -----------
38+ Storgage
39+ --------
5440
5541All compute nodes and front-end are connected to a `ClusterStor storage
5642system <usage/lustre> `:
5743large disk arrays with the Lustre filesystem on top of it cross-mounted
5844under ``/scratch `` directory. The system provides about 5PB of disk
5945space available to end-user.
6046
61- Software
62- --------
47+ System software
48+ ---------------
6349
64- The cluster is running open source software infrastructure: CentOS 7,
50+ The cluster is running open source software infrastructure: Red Hat Enterprise Linux
6551with SLURM as the scheduler and batch system.
6652
0 commit comments