-
Notifications
You must be signed in to change notification settings - Fork 1
Expand file tree
/
Copy pathindex.qmd
More file actions
31 lines (20 loc) · 1.42 KB
/
index.qmd
File metadata and controls
31 lines (20 loc) · 1.42 KB
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
---
title: "Virtual Stores at NASA"
subtitle: "Unifying access to NASA datasets"
authors: Aimee Barciauskas, Ed Armstrong, Daniel Kaufman, Chris Battisto, Hailiang Zhang, Christine Smit, Jack McNelis
---
⚠️ UNDER DEVELOPMENT ⚠️
## Vision: NASA datasets accessible through a single entrypoint
<img style="height: 150px; margin: 0px auto; display: block" alt="Simple Virtual Zarr Graphic" src="./graphics/simple-virtual-zarr.svg" />
Virtual stores deliver a single entrypoint to a dataset comprised of many files. For NASA datasets this enables:
* Less pre-processing to be "analysis-ready".
* Users do not have to know about the underlying data format or storage location.
* Greater interoperability through a common API for reading, writing and analyzing complex and heterogeneous NASA datasets.
## What are virtual stores and what do they enable?
Core to virtual store technology is lightweight metadata pointing to data byte ranges in existing files. Virtual store technology enables data users to access subsets of large scientific datasets without downloading, scanning and pre-processing any files.
## Benefits for data users
- Logical dataset access access large number of files, without downloading any data
- Consistent access patterns across diverse data types
## Benefits for data providers and NASA
- Cost savings through reduced egress and compute
- Providing analysis-ready access to existing archives without reformatting