Skip to content

Commit 0629cac

Browse files
authored
Include intermediate data in repo (#48)
* add vector data cube and update gitignore * update instructions to ignore vector cube zarr data * fix link ref in summary * clear nbs + one small change * Update .gitignore remove old nb dir from gitignore
1 parent d3af6e3 commit 0629cac

File tree

467 files changed

+4109
-18
lines changed

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

467 files changed

+4109
-18
lines changed

.gitignore

Lines changed: 2 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -10,10 +10,8 @@ package.json
1010
utils/get_links.py
1111

1212
#Data
13-
**/data/raster_data/*
14-
15-
#Extra nbs
16-
sentinel1/subste_nbs
13+
sentinel1/data/raster_data/*
14+
itslive/data/raster_data/single_glacier_itslive.zarr/*
1715

1816
# Byte-compiled / optimized / DLL files
1917
__pycache__/

book/background/5_software.md

Lines changed: 8 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -13,7 +13,10 @@ There are two options for creating a software environment: [pixi](https://pixi.s
1313
2. Navigate into the repo environment:
1414
```cd cloud-open-source-geospatial-datacube-workflows```
1515

16-
3. Execute `pixi run` for each tutorial:
16+
3. There is a small data cube included in the repo that is used in the tutorials. We don't want git to track this so we tell it to ignore this file path.
17+
```git update-index --assume-unchanged book/itslive/data/raster_data/regional_glacier_velocity_vector_cube.zarr/.```
18+
19+
4. Execute `pixi run` for each tutorial:
1720
```pixi run itslive```
1821
```pixi run sentinel1```
1922

@@ -30,7 +33,10 @@ Note that the first `pixi run` will download specific versions of all required P
3033
3. Create and activate a conda environment from the `environment.yml` file located in the repo:
3134
```conda env create -f environment.yml```
3235

33-
4. Start Jupyterlab and navigate to the directories containing the Jupyter notebooks (`itslive/nbs` and `s1/nbs`):
36+
4. There is a small data cube included in the repo that is used in the tutorials. We don't want git to track this so we tell it to ignore this file path.
37+
```git update-index --assume-unchanged book/itslive/data/raster_data/regional_glacier_velocity_vector_cube.zarr/.```
38+
39+
5. Start Jupyterlab and navigate to the directories containing the Jupyter notebooks (`itslive/nbs` and `s1/nbs`):
3440
```jupyterlab```
3541

3642
Both tutorials use functions that are stored in scripts associated with each dataset. You can find these scripts here: [`itslive_tools.py`](../itslive/nbs/itslive_tools.py) and [`s1_tools.py`](../sentinel1/nbs/s1_tools.py).

book/conclusion/summary.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -29,7 +29,7 @@ We saw many examples of situations where it would have been very difficult to ac
2929
## Data visualization
3030
We used a number of visualization tools in these tutorials, each of which are appropriate for different situations and use-cases. These include interactive and static visualizations and plotting tools optimized for n-d array and vector datasets.
3131

32-
- [ITS_LIVE, nb3](https://e-marshall.github.io/cloud-open-source-geospatial-datacube-workflows/itslive/nbs/3_combining_raster_vector_data.html#crop-vector-data-to-spatial-extent-of-raster-data), [Adding basemaps to plots of raster and vector data, ITS_LIVE nb4](https://e-marshall.github.io/cloud-open-source-geospatial-datacube-workflows/itslive/nbs/4_exploratory_data_analysis_single.html#load-raster-data-and-visualize-with-vector-data), [Interactive visualization of vector data cubes with Xvec and GeoPandas](https://e-marshall.github.io/cloud-open-source-geospatial-datacube-workflows/itslive/nbs/5_exploratory_data_analysis_group.html#visualize-velocity-data), [Interactive visualization of 2-d data with Xarray and holoviz, Sentinel-1 nb3](https://e-marshall.github.io/cloud-open-source-geospatial-datacube-workflows/sentinel1/nbs/3_asf_exploratory_analysis.html#interactive-visualization-of-layover-shadow-maps), [Using xr.FacetGrid for data inspection and cleaning](https://e-marshall.github.io/cloud-open-source-geospatial-datacube-workflows/sentinel1/nbs/3_asf_exploratory_analysis.html#d-duplicate-time-steps), [Different ways of plotting 2-d data side-by-side, Sentinel-1 nb3](https://e-marshall.github.io/cloud-open-source-geospatial-datacube-workflows/sentinel1/nbs/3_asf_exploratory_analysis.html#f-data-visualization), [Interactive visualization of time series data with Xarray and holoviz](https://e-marshall.github.io/cloud-open-source-geospatial-datacube-workflows/sentinel1/nbs/3_asf_exploratory_analysis.html#backscatter-time-series), and [here](https://e-marshall.github.io/cloud-open-source-geospatial-datacube-workflows/sentinel1/nbs/5_comparing_s1_rtc_datasets.html#d-visualize-comparisons).
32+
- [ITS_LIVE, nb3](https://e-marshall.github.io/cloud-open-source-geospatial-datacube-workflows/itslive/nbs/3_combining_raster_vector_data.html#crop-vector-data-to-spatial-extent-of-raster-data), [Adding basemaps to plots of raster and vector data, ITS_LIVE nb4](https://e-marshall.github.io/cloud-open-source-geospatial-datacube-workflows/itslive/nbs/4_exploratory_data_analysis_single.html#load-raster-data-and-visualize-with-vector-data), [Interactive visualization of vector data cubes with Xvec and GeoPandas](https://e-marshall.github.io/cloud-open-source-geospatial-datacube-workflows/itslive/nbs/5_exploratory_data_analysis_group.html#visualize-velocity-data), [Interactive visualization of 2-d data with Xarray and holoviz, Sentinel-1 nb3](https://e-marshall.github.io/cloud-open-source-geospatial-datacube-workflows/sentinel1/nbs/3_asf_exploratory_analysis.html#interactive-visualization-of-layover-shadow-maps), [Using xr.FacetGrid for data inspection and cleaning](https://e-marshall.github.io/cloud-open-source-geospatial-datacube-workflows/sentinel1/nbs/3_asf_exploratory_analysis.html#d-duplicate-time-steps), [Different ways of plotting 2-d data side-by-side, Sentinel-1 nb3](https://e-marshall.github.io/cloud-open-source-geospatial-datacube-workflows/sentinel1/nbs/3_asf_exploratory_analysis.html#f-data-visualization), [Interactive visualization of time series data with Xarray and holoviz](https://e-marshall.github.io/cloud-open-source-geospatial-datacube-workflows/sentinel1/nbs/3_asf_exploratory_analysis.html#backscatter-time-series), and [Visual dataset comparison](https://e-marshall.github.io/cloud-open-source-geospatial-datacube-workflows/sentinel1/nbs/5_comparing_s1_rtc_datasets.html#d-visualize-comparisons).
3333

3434
## Making analysis-ready data cubes
3535
Several notebooks focused on the tasks of organizing data cubes so that they were appropriate representations of physical observables and attaching relevant metadata to relevant variables and along appropriate dimensions.
Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1 @@
1+
{}
Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,3 @@
1+
{
2+
"zarr_format": 2
3+
}

0 commit comments

Comments
 (0)