Skip to content

Commit 735c6d3

Browse files
updated daos and datamover userguide to improve technical readability
1 parent 73d1646 commit 735c6d3

File tree

7 files changed

+763
-408
lines changed

7 files changed

+763
-408
lines changed

docs/aurora/data-management/daos/daos-overview.md

Lines changed: 313 additions & 293 deletions
Large diffs are not rendered by default.
-74.9 KB
Loading
Lines changed: 89 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,89 @@
1+
Darshan install notes (Aurora)
2+
3+
1. Runtime install (DAOS + HDF5 + PnetCDF)
4+
5+
Commands:
6+
module use /soft/modulefiles
7+
module load daos
8+
module load cmake
9+
module load hdf5
10+
module load parallel-netcdf
11+
12+
git clone https://github.com/darshan-hpc/darshan.git
13+
cd darshan
14+
./prepare.sh
15+
16+
./configure \
17+
--enable-daos-mod \
18+
--enable-hdf5-mod \
19+
--with-hdf5=/opt/aurora/25.190.0/spack/unified/0.10.1/install/linux-sles15-x86_64/oneapi-2025.2.0/hdf5-1.14.6-zkruqq7 \
20+
--enable-pnetcdf-mod \
21+
--with-pnetcdf=/opt/aurora/25.190.0/spack/unified/0.10.1/install/linux-sles15-x86_64/oneapi-2025.2.0/parallel-netcdf-1.12.3-qfkwxue \
22+
--with-log-path=/lus/flare/projects/Aurora_deployment/kaushik/darshan-software/logs \
23+
--with-jobid-env=PBS_JOBID \
24+
--prefix=/lus/flare/projects/Aurora_deployment/kaushik/darshan-software/install \
25+
'CFLAGS=-O2 -g -Wall' \
26+
CC=mpicc
27+
28+
make install
29+
30+
Note:
31+
HDF5 and PnetCDF paths come from:
32+
module show hdf5
33+
module show parallel-netcdf
34+
35+
Optional permission step used in original notes:
36+
chmod -R 755 /lus/flare/projects/Aurora_deployment/kaushik/darshan-software/
37+
38+
Check config:
39+
/lus/flare/projects/Aurora_deployment/kaushik/darshan-software/install/bin/darshan-config --log-path
40+
41+
Create log directory hierarchy once:
42+
cd /lus/flare/projects/Aurora_deployment/kaushik/darshan-software/install/bin
43+
./darshan-mk-log.pl
44+
45+
2. Set custom logfile (optional)
46+
47+
export DARSHAN_LOGFILE=<full-path-to-darshan-logfile>
48+
49+
3. Quick runtime tests
50+
51+
Non-MPI:
52+
LD_PRELOAD=/path/to/libdarshan.so DARSHAN_ENABLE_NONMPI=1 cat /some/file
53+
54+
MPI:
55+
LD_PRELOAD=/path/to/libdarshan.so mpiexec ...
56+
57+
Example:
58+
touch hello.txt
59+
LD_PRELOAD=/lus/flare/projects/Aurora_deployment/kaushik/darshan-software/install/lib/libdarshan.so DARSHAN_ENABLE_NONMPI=1 cat hello.txt
60+
ls /lus/flare/projects/Aurora_deployment/kaushik/darshan-software/logs/2025/11/14/
61+
62+
4. darshan-util / PyDarshan tools install
63+
64+
rm -rf /lus/flare/projects/Aurora_deployment/kaushik/darshan-software/darshan/
65+
git clone https://github.com/darshan-hpc/darshan.git
66+
cd darshan
67+
git submodule update --init
68+
./prepare.sh
69+
70+
cd darshan-util
71+
./configure \
72+
--disable-darshan-runtime \
73+
--prefix=/lus/flare/projects/Aurora_deployment/kaushik/darshan-software/darshan-util-install \
74+
--enable-apmpi-mod \
75+
--enable-apxc-mod \
76+
CFLAGS='-g -O0 -Wall'
77+
78+
make
79+
make install
80+
81+
List installed tools:
82+
ls /lus/flare/projects/Aurora_deployment/kaushik/darshan-software/darshan-util-install/bin/
83+
84+
5. Full preload chain
85+
86+
LD_PRELOAD=/lus/flare/projects/Aurora_deployment/kaushik/darshan-software/install/lib/libdarshan.so:\
87+
/opt/aurora/25.190.0/spack/unified/0.10.1/install/linux-sles15-x86_64/oneapi-2025.2.0/hdf5-1.14.6-zkruqq7/lib/libhdf5.so:\
88+
/opt/aurora/25.190.0/spack/unified/0.10.1/install/linux-sles15-x86_64/oneapi-2025.2.0/parallel-netcdf-1.12.3-qfkwxue/lib/libpnetcdf.so:\
89+
/usr/lib64/libpil4dfs.so

docs/aurora/data-management/moving_data_to_aurora/daos_datamover.md

Lines changed: 0 additions & 114 deletions
This file was deleted.

0 commit comments

Comments
 (0)