Skip to content

Commit 9152fa7

Browse files
authored
Merge pull request #318 from bbglab/s3-update-access
Refactor code structure for readability and maintainability
2 parents 1e5ce07 + 9794758 commit 9152fa7

File tree

2 files changed

+19
-7
lines changed

2 files changed

+19
-7
lines changed

docs/Cluster_basics/s3.md

Lines changed: 19 additions & 7 deletions
Original file line numberDiff line numberDiff line change
@@ -8,7 +8,7 @@
88
- [How to access](#how-to-access)
99
- [Terminal from IRB cluster](#terminal-from-irb-cluster)
1010
- [Open OnDemand](#open-ondemand)
11-
- [Mount bucket on local](#mount-bucket-on-local)
11+
- [Mount bucket on local](#mount-bucket-on-local-terminal-on-local)
1212
- [How to use it](#how-to-use-it)
1313
- [Seqera and Nextflow](#seqera-and-nextflow)
1414
- [Python](#python)
@@ -50,8 +50,15 @@ files (e.g., metadata, images).~~
5050

5151
MinIO web access to S3 is now only available to users on paid plans. It is no longer accessible to IRB members.
5252

53-
From now on, access to S3 is only possible via the terminal (e.g., to navigate, run Python scripts, or execute Nextflow
54-
pipelines outside Seqera). To use terminal access, you need to generate S3 credentials.
53+
From now on, access to S3 **with write permissions is only possible** via the terminal (e.g., to navigate, run
54+
Python scripts, or execute Nextflow pipelines outside Seqera). To use terminal access, you need to generate S3
55+
credentials.
56+
57+
If you want to navigate S3 buckets — whether to check the file structure or read PDFs, Excel files, or text
58+
files — you can do so using [Open OnDemand](#open-ondemand) or by
59+
[mounting them](#mount-bucket-on-local-terminal-on-local).
60+
You can create the credentials directly from Open OnDemand or with the local tool. Check the corresponding
61+
section for details.
5562

5663
If you only want to use S3 files in your Nextflow pipelines through [seqera platform](https://cloud.seqera.io/), no
5764
further setup is needed. Credentials are already configured in the pipelines; you only need to export them.
@@ -119,7 +126,8 @@ $ ls /home/mgrau/s3/bbg-scratch/
119126
work
120127
# Unmount
121128
$ fusermount -u /home/mgrau/s3/bbg-scratch
122-
[1]+ Done rclone mount irb-minio:bbg-scratch /home/mgrau/s3/bbg-scratch --vfs-cache-mode off --read-only
129+
[1]+ Done rclone mount irb-minio:bbg-scratch /home/mgrau/s3/bbg-scratch
130+
--vfs-cache-mode off --read-only
123131
$ ls /home/mgrau/s3/bbg-scratch/
124132
$
125133
```
@@ -143,17 +151,21 @@ download files, but you cannot modify existing objects or upload new ones from t
143151
1. Go to
144152
[Open OnDemand Dashboard](https://ood.sc.irbbarcelona.org/pun/sys/dashboard/)
145153
and log in with your LDAP credentials.
146-
2. Click on "Home Directory System installed App".
154+
155+
2. Verify that your credentials are valid, or create new ones if they have expired.
156+
![s3 open onDemand credentials](../assets/images/s3-ooo-credentials.png)
157+
158+
3. Once the credentials are valid, click on the "Home Directory System" section.
147159

148160
![Open OnDemand Home Directory System app screenshot](../assets/images/ooo-home-directory.png)
149161

150-
3. Select the S3 storage on the left panel and navigate through the folders.
162+
4. Select the S3 storage on the left panel and navigate through the folders.
151163
You can read PDFs and text files directly in the browser.
152164
To view Excel or HTML files, you need to download them first.
153165

154166
![Open OnDemand S3 storage browser screenshot](../assets/images/ooo-s3.png)
155167

156-
### Mount bucket on local
168+
### Mount bucket on local. Terminal on local
157169

158170
It is also possible to mount the S3 storage as a local partition (as we do with MacGyver and the workspace/).
159171
This is a read-only option.
52.6 KB
Loading

0 commit comments

Comments
 (0)