Skip to content
Merged
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
6 changes: 3 additions & 3 deletions docs/hpc/03_storage/02_data_transfers.md
Original file line number Diff line number Diff line change
Expand Up @@ -9,12 +9,12 @@ Attached to the NYU HPC cluster Torch, the Torch Data Transfer Node (gDTN) are

### Data Transfer Node Access
The HPC cluster filesystems include `/home`, `/scratch`, `/archive` and the [HPC Research Project Space](./04_research_project_space.mdx) are available on the gDTN. The Data-Transfer Node (DTN) can be accessed in a variety of ways
- From NYU-net and the High Speed Research Network: use SSH to the DTN hostname `dtn011.hpc.nyu.edu` or `dtn012.hpc.nyu.edu`
- From NYU-net and the High Speed Research Network: use SSH to the DTN hostname `dtn.torch.hpc.nyu.edu` which resolves to either `dtn011.hpc.nyu.edu` or `dtn012.hpc.nyu.edu`

:::info
For example, to log in to a DTN from the Torch cluster, to carry out some copy operation, and to log back out, you can use a command sequence like:
```sh
ssh dtn012.hpc.nyu.edu
ssh dtn.torch.hpc.nyu.edu
rsync ...
logout
```
Expand All @@ -32,7 +32,7 @@ Please use Data Transfer Nodes (DTNs) with these tools. While one can transfer d

Sometimes these two tools are convenient for transferring small files. Using the DTNs does not require to set up an SSH tunnel; use the hostname `dtn.torch.hpc.nyu.edu` for one-step copying. See below for examples of commands invoked on the command line on a laptop running a Unix-like operating system:
```sh
rsync -av HMLHWBGX7_n01_HK16.fastq.gz jdoe55@dtn012.hpc.nyu.edu:/scratch/jdoe55/
rsync -av HMLHWBGX7_n01_HK16.fastq.gz jdoe55@dtn.torch.hpc.nyu.edu:/scratch/jdoe55/
```
In particular, rsync can also be used on the DTNs to copy directories recursively between filesystems, e.g. (assuming that you are logged in to a DTN),
```sh
Expand Down
Loading