Skip to content

Commit 68866db

Browse files
trey-staffordtrey-stafford
authored
Merge pull request #29 from nsidc/nsidc-demo-slides
NSIDC demo slides
2 parents fb5a3e4 + 7236485 commit 68866db

9 files changed

+177
-20
lines changed

‎doc/_quarto.yml‎

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -23,6 +23,8 @@ website:
2323
text: "Docs"
2424
- href: cires_rendezvous_poster.md
2525
text: "CIRES Rendezvous 2025 poster"
26+
- href: dat_nsidc_demo_slides.qmd
27+
text: "NSIDC DAT Demo Slides"
2628

2729
page-footer:
2830
left: "© NSIDC 2025"

‎doc/cires_rendezvous_poster.md‎

Lines changed: 14 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -40,3 +40,17 @@ Tool:
4040
- [MODIS/Terra Snow Cover Daily L3 Global 500m SIN Grid, Version 61 (MOD10A1)](https://nsidc.org/data/data-access-tool/MOD10A1/versions/61)
4141
- [High Mountain Asia 8-meter DEM Mosaics Derived from Optical Imagery, Version 1 (HMA_DEM8m_MOS)](https://nsidc.org/data/data-access-tool/HMA_DEM8m_MOS/versions/1)
4242
- [SMAP Enhanced L3 Radiometer Global and Polar Grid Daily 9 km EASE-Grid Soil Moisture, Version 6 (SPL3SMP_E)](https://nsidc.org/data/data-access-tool/SPL3SMP_E/versions/6)
43+
44+
## Data Access Tool Software
45+
46+
The Data Access Tool is composed of three open source repositories in GitHub:
47+
48+
- [data-access-tool-ui](https://github.com/nsidc/data-access-tool-ui): Web
49+
interface to support granule-level discovery and access of NASA Earthdata for
50+
a given data collection.
51+
52+
- [data-access-tool-backend](https://github.com/nsidc/data-access-tool-backend):
53+
backend services that support the Python bulk download script and Earthdata
54+
Download.
55+
- [data-access-tool-vm](https://github.com/nsidc/data-access-tool-vm): NSIDC
56+
virtual machine configuration for deploying the backend service.

‎doc/dat_annotated_screenshot.jpg‎

575 KB
Loading

‎doc/dat_nsidc_demo_slides.qmd‎

Lines changed: 135 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,135 @@
1+
---
2+
title: "Earthdata Download & Data Access Tool (EDDAT)"
3+
date: "2025-05-14"
4+
format: revealjs
5+
author:
6+
- name: "Trey Stafford"
7+
- name: "Amy Steiker"
8+
- name: "Colin Nickerson"
9+
- name: "Leslie Goldman"
10+
---
11+
12+
13+
# Data Access Tool (DAT)
14+
15+
Web-based Javascript application that provides an interface for users to find,
16+
filter, and download data files associated with NSIDC DAAC datasets.
17+
18+
:::: {.columns}
19+
20+
::: {.column width="50%"}
21+
**Filter**
22+
23+
🕙 Temporal
24+
25+
🌐 Spatial
26+
27+
🔎 Filename
28+
:::
29+
30+
::: {.column width="50%"}
31+
**Download**
32+
33+
🐍 Python download script
34+
35+
💾 NASA Earthdata Download
36+
37+
🚀 NASA Earthdata Search
38+
39+
:::
40+
::::
41+
42+
43+
# DAT Usage and impact
44+
🗓️ Originally released in late 2018
45+
46+
👤 28% of total DAAC data users
47+
48+
🗃️ 739 datasets served
49+
50+
🥧 17% of total NASA DAAC data download volume
51+
52+
53+
#
54+
55+
![Total DAT views for each month from May 2023-April 2025. In total, the DAT
56+
served over 100k page views for over 35k users. Note: data for September 2024
57+
is incomplete. ](dat_usage.png)
58+
59+
60+
#
61+
62+
::: {.r-fit-text}
63+
![The DAT page for High Mountain Asia 8-meter DEM Mosaics Derived from Optical Imagery, Version 1 (HMA_DEM8m_MOS). The dataset’s coverage is shown in the Map viewer in teal. A user’s spatial polygon selection is shown in red, selecting 80 of the dataset’s 417 files. Annotations show major features and download options.](dat_annotated_screenshot.jpg)
64+
:::
65+
66+
# EDDAT Motivation
67+
68+
ECS decommissioning - July 2026!
69+
70+
* Update to support cloud collections
71+
* Replace ECS-based order option with Earthdata Download
72+
73+
# Earthdata Download
74+
75+
::: {.r-fit-text}
76+
[Earthdata Download](https://github.com/nasa/earthdata-download) is an
77+
[Electron](https://www.electronjs.org/) desktop application designed to
78+
facilitate large downloads of granules from Earthdata Search.
79+
80+
Users download and install Earthdata Download to their personal computers.
81+
:::
82+
83+
![Earthdata Download](edd_screenshot.png)
84+
85+
# Demo
86+
87+
::: {.r-fit-text}
88+
<https://nsidc.org/data/data-access-tool/HMA_DEM8m_MOS/versions/1>
89+
:::
90+
91+
92+
::: {.r-fit-text}
93+
# Software Architecture
94+
95+
![High-level software architecture diagram for the DAT. The DAT is embedded in
96+
dataset-specific pages powered by Drupal. Drupal provides the DAT with the
97+
dataset name and version. The DAT then uses NASA CMR to query for dataset
98+
metadata.](high_level_architecture.png)
99+
:::
100+
101+
#
102+
103+
::: {style="transform: scale(0.75); transform-origin: center;"}
104+
{{< include edd_sequence_diagram.qmd >}}
105+
:::
106+
107+
::: {.r-fit-text}
108+
High-level sequence diagram showing interaction between the DAT UI, DAT Backend,
109+
and Earthdata Download.
110+
:::
111+
112+
# Future Evolution
113+
114+
NSIDC DAAC plans to collaborate with teams across the NASA Earth Science Data
115+
Systems program to scale the DAT into an enterprise tool, with the goal of
116+
serving all NASA Earthdata datasets as an integrated application within the NASA
117+
Earthdata website.
118+
119+
# CIRES Rendezvous 2025
120+
121+
![CIRES Rendezvous 2025 poster](cires_rendezvous_poster.jpg)
122+
123+
124+
# References
125+
126+
* See [CIRES Rendezvous 2025 poster landing page](cires_rendezvous_poster.md)
127+
for more info about the poster, and links to example DAT pages for popular
128+
datasets.
129+
* [NSIDC DAT help
130+
article](https://nsidc.org/data/user-resources/help-center/filter-and-order-data-set-web-page-using-data-access-tool)
131+
* [NSIDC Earthdata Download help
132+
article](https://nsidc.org/data/user-resources/help-center/how-to-use-earthdata-download)
133+
* [NASA Earthdata Download downloads page](https://nasa.github.io/earthdata-download/)
134+
135+
# Questions?

‎doc/dat_usage.png‎

41.5 KB
Loading

‎doc/developing_with_edd.qmd‎

Lines changed: 1 addition & 20 deletions
Original file line numberDiff line numberDiff line change
@@ -32,26 +32,7 @@ between the DAT UI, the backend, and Earthdata Download.
3232
the last couple of steps until the results are exhausted. The user now has all
3333
of the granules they requested downloaded to their computer.
3434

35-
```{mermaid}
36-
sequenceDiagram
37-
actor user
38-
participant DAT-UI
39-
participant DAT-backend
40-
participant Earthdata Download
41-
42-
user->>DAT-UI: Make selections <br>and click EDD button
43-
DAT-UI ->> Earthdata Download: Open EDD via "deep link" containing getLinks<br> and EDL auth callback URLs
44-
loop n pages of CMR results
45-
Earthdata Download->>DAT-backend: Request page of download URLs via getLinks URL
46-
DAT-backend->>Earthdata Download: Send page of data download URLs
47-
opt if EDL is required for download
48-
Earthdata Download->>DAT-backend: request EDL auth
49-
DAT-backend->>Earthdata Download: open auth callback deep-link, providing EDL token
50-
51-
end
52-
Note left of Earthdata Download: Download data<br>to user computer.
53-
end
54-
```
35+
{{< include edd_sequence_diagram.qmd >}}
5536

5637
## Earthdata login
5738

‎doc/edd_screenshot.png‎

1.91 MB
Loading

‎doc/edd_sequence_diagram.qmd‎

Lines changed: 20 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,20 @@
1+
```{mermaid}
2+
sequenceDiagram
3+
actor user
4+
participant DAT-UI
5+
participant DAT-backend
6+
participant Earthdata Download
7+
8+
user->>DAT-UI: Make selections <br>and click EDD button
9+
DAT-UI ->> Earthdata Download: Open EDD via "deep link" containing getLinks<br> and EDL auth callback URLs
10+
loop n pages of CMR results
11+
Earthdata Download->>DAT-backend: Request page of download URLs via getLinks URL
12+
DAT-backend->>Earthdata Download: Send page of data download URLs
13+
opt if EDL is required for download
14+
Earthdata Download->>DAT-backend: request EDL auth
15+
DAT-backend->>Earthdata Download: open auth callback deep-link, providing EDL token
16+
17+
end
18+
Note left of Earthdata Download: Download data<br>to user computer.
19+
end
20+
```

‎doc/getting_started.md‎

Lines changed: 5 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -57,3 +57,8 @@ docker compose logs -f
5757
```
5858

5959
:::
60+
61+
## Data Access Tool UI
62+
63+
See the [data-access-tool-ui](https://github.com/nsidc/data-access-tool-ui)
64+
project for information on how to get the UI setup for testing and development.

0 commit comments

Comments
 (0)