Skip to content

Commit 9f4a6e2

Browse files
committed
Clarify that credentials are not required
1 parent 8b179b7 commit 9f4a6e2

File tree

2 files changed

+8
-6
lines changed

2 files changed

+8
-6
lines changed

tutorials/cloud_access/cloud-access-intro.md

Lines changed: 3 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -49,7 +49,9 @@ The cloud connection is handled by a separate library, usually [s3fs](https://s3
4949

5050
The IRSA buckets are public and access is free.
5151
Credentials are not required.
52-
Anonymous connections can be made, often by setting a keyword argument like `anon=True`.
52+
However, most tools will look for credentials by default and raise an error when none are found.
53+
To avoid this, users can make an "anonymous" connection, usually with a keyword argument such as `anon=True`.
54+
This notebook demonstrates with the `s3fs`, `astropy`, and `pyarrow` libraries.
5355

5456
+++
5557

tutorials/parquet-catalog-demos/wise-allwise-catalog-demo.md

Lines changed: 5 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -32,6 +32,7 @@ kernelspec:
3232

3333
This notebook demonstrates access to the [HEALPix](https://ui.adsabs.harvard.edu/abs/2005ApJ...622..759G/abstract)-partitioned (order 5), [Apache Parquet](https://parquet.apache.org/) version of the [AllWISE Source Catalog](https://wise2.ipac.caltech.edu/docs/release/allwise/expsup/sec1_3.html#src_cat).
3434
The catalog is available through the [AWS Open Data](https://aws.amazon.com/opendata) program, as part of the [NASA Open-Source Science Initiative](https://science.nasa.gov/open-science-overview).
35+
Access is free and no special permissions or credentials are required.
3536

3637
Parquet is convenient for large astronomical catalogs in part because the storage format supports efficient database-style queries on the files themselves, without having to load the catalog into a database (or into memory) first.
3738
The AllWISE catalog is fairly large at 340 GB.
@@ -65,13 +66,12 @@ from pyarrow.fs import S3FileSystem
6566

6667
+++
6768

68-
This AllWISE catalog is stored in an [AWS S3](https://aws.amazon.com/s3/) bucket.
69-
To connect to an S3 bucket we just need to point the reader at S3 instead of the local filesystem, and pass in AWS credentials.
69+
This AllWISE catalog is stored in an [AWS S3](https://aws.amazon.com/s3/) cloud storage bucket.
70+
To connect to an S3 bucket we just need to point the reader at S3 instead of the local filesystem.
7071
(Here, a "reader" is a python library that reads parquet files.)
7172
We'll use [pyarrow.fs.S3FileSystem](https://arrow.apache.org/docs/python/generated/pyarrow.fs.S3FileSystem.html) for this because it is recognized by every reader in examples below, and we're already using pyarrow.
72-
[s3fs](https://s3fs.readthedocs.io/en/latest/index.html) is another common option.
73-
The call to `S3FileSystem` will look for AWS credentials in environment variables and/or the file ~/.aws/credentials.
74-
Credentials can also be passed as keyword arguments.
73+
To access without credentials, we'll use the keyword argument `anonymous=True`.
74+
More information about accessing S3 buckets can be found at [](#cloud-access-intro).
7575

7676
```{code-cell} ipython3
7777
bucket = "nasa-irsa-wise"

0 commit comments

Comments
 (0)