Skip to content

Commit 56c6d0f

Browse files
committed
Update the readthedocs page
1 parent 9fd3ae5 commit 56c6d0f

File tree

1 file changed

+11
-2
lines changed

1 file changed

+11
-2
lines changed

docs/source/dlio.rst

Lines changed: 11 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -3,8 +3,17 @@ DLIO
33

44
The benchmark is designed to measure the performance of training and evaluation of deep learning models on data stored
55
as HDF5 files. Based on collected and analysed I/O patterns from `DLIO Benchmark <https://github.com/argonne-lcf/dlio_benchmark>`_,
6-
this benchmark simulates the learning process and evaluation of deep learning models using PyTorch and Tensorflow
7-
frameworks, while gathering valuable information about system performance.
6+
this benchmark simulates the learning process and evaluation of deep learning models that use PyTorch and Tensorflow
7+
frameworks, while gathering valuable information about system performance. Most importantly, this extension allows users
8+
to test AI workloads without the need to install machine learning libraries, reducing complexity and enhancing the
9+
usability of the benchmark. Another advantage is that from our experiments, our extension ran faster than DLIO Benchmark,
10+
which we suspect was due to the difference in the overhead introduced by the C application in our extension and the
11+
Python application in the original benchmark. While the quicker runtime could be beneficial for faster testing, it also
12+
suggests that the benchmark might not fully capture the complexity of real AI workloads, such as high metadata
13+
operations introduced by the use of Python-based libraries. I/O pattern produced by this extension is based on the
14+
implementation of `DLIO benchmark version 1.1 <https://github.com/argonne-lcf/dlio_benchmark/releases/tag/v1.1>`_.
15+
Changes in the main DLIO Benchmark configurations after version 1.1 will not be reflected in this h5bench pattern. To
16+
reproduce them, DLIO Benchmark behavior can be studied using various I/O analysis tools. We recommend using Log VFD.
817

918
Configuration
1019
-------------

0 commit comments

Comments
 (0)