Skip to content

Commit 6a303ba

Browse files
committed
update fork
2 parents a35b8c3 + 2edb736 commit 6a303ba

File tree

6 files changed

+32
-79
lines changed

6 files changed

+32
-79
lines changed

CITATION.cff

Lines changed: 7 additions & 54 deletions
Original file line numberDiff line numberDiff line change
@@ -1,64 +1,17 @@
11
cff-version: 1.2.0
22
message: "If you use this cookbook, please cite it as below."
33
authors:
4-
# add additional entries for each author -- see https://github.com/citation-file-format/citation-file-format/blob/main/schema-guide.md
5-
- family-names: Kalauni
6-
given-names: Nabin
7-
orcid: https://orcid.org/0009-0006-8783-0446
8-
website: https://nkalauni.github.io
9-
affiliation: The University of Arizona
10-
# add additional entries for each author -- see https://github.com/citation-file-format/citation-file-format/blob/main/schema-guide.
11-
- family-names: Fallah
12-
given-names: Ali
13-
orcid: https://orcid.org/0000-0001-8273-4638
14-
website: https://github.com/alifallahm
15-
affiliation: University of Massachusetts Lowell (NCAR Intern)
164
- family-names: Ganz
175
given-names: Keenan
186
orcid: https://orcid.org/0000-0002-8486-3959
197
website: https://github.com/s-kganz
208
affiliation: University of Washington
21-
- family-names: Rose
22-
given-names: Brian E. J.
23-
orcid: https://orcid.org/0000-0002-9961-3821 # optional
24-
website: https://github.com/brian-rose # optional
25-
affiliation: University at Albany (State University of New York) # optional
26-
- family-names: Kent
27-
given-names: Julia
28-
orcid: https://orcid.org/0000-0002-5611-8986
29-
website: https://github.com/jukent
30-
affiliation: UCAR/NCAR
31-
- family-names: Tyle
32-
given-names: Kevin
33-
orcid: https://orcid.org/0000-0001-5249-9665
34-
website: https://github.com/ktyle
35-
affiliation: University at Albany (State University of New York)
36-
- family-names: Clyne
37-
given-names: John
38-
orcid: https://orcid.org/0000-0003-2788-9017
39-
website: https://github.com/clyne
40-
affiliation: UCAR/NCAR
41-
- family-names: Camron
42-
given-names: Drew
43-
orcid: https://orcid.org/0000-0001-7246-6502
44-
website: https://github.com/dcamron
45-
affiliation: UCAR/Unidata
46-
- family-names: Grover
47-
given-names: Maxwell
48-
orcid: https://orcid.org/0000-0002-0370-8974
49-
website: https://github.com/mgrover1
50-
affiliation: Argonne National Laboratory
51-
- family-names: Ford
52-
given-names: Robert R.
53-
orcid: https://orcid.org/0000-0001-5483-4965
54-
website: https://github.com/r-ford
55-
affiliation: University at Albany (State University of New York)
56-
- family-names: Paul
57-
given-names: Kevin
58-
orcid: https://orcid.org/0000-0001-8155-8038
59-
website: https://github.com/kmpaul
60-
affiliation: NVIDIA
9+
- family-names: Kalauni
10+
given-names: Nabin
11+
orcid: https://orcid.org/0009-0006-8783-0446
12+
website: https://nkalauni.github.io
13+
affiliation: The University of Arizona
6114
- name: "Cookbook Template contributors" # use the 'name' field to acknowledge organizations
6215
website: "https://github.com/ProjectPythia/cookbook-template/graphs/contributors"
63-
title: "Cookbook Template"
64-
abstract: "A sample cookbook description."
16+
title: "Xarray for Deep Learning"
17+
abstract: "A workflow on recreating xarray datasets from deep learning model outputs."

README.md

Lines changed: 17 additions & 21 deletions
Original file line numberDiff line numberDiff line change
@@ -1,40 +1,38 @@
1-
# (Replace_with_your_title) Cookbook
1+
# Xarray for Deep Learning Cookbook
22

33
<img src="thumbnails/thumbnail.png" alt="thumbnail" width="300"/>
44

55
[![nightly-build](https://github.com/ProjectPythia/cookbook-template/actions/workflows/nightly-build.yaml/badge.svg)](https://github.com/ProjectPythia/cookbook-template/actions/workflows/nightly-build.yaml)
66
[![Binder](https://binder.projectpythia.org/badge_logo.svg)](https://binder.projectpythia.org/v2/gh/ProjectPythia/cookbook-template/main?labpath=notebooks)
77
[![DOI](https://zenodo.org/badge/475509405.svg)](https://zenodo.org/badge/latestdoi/475509405)
88

9-
_See the [Cookbook Contributor's Guide](https://projectpythia.org/cookbook-guide) for step-by-step instructions on how to create your new Cookbook and get it hosted on the [Pythia Cookbook Gallery](https://cookbooks.projectpythia.org)!_
10-
11-
This Project Pythia Cookbook covers ... (replace `...` with the main subject of your cookbook ... e.g., _working with radar data in Python_)
9+
This Project Pythia Cookbook covers a workflow for using Xarray and xbatcher for deep learning applications. Specifically, it demonstrates a reusable workflow for recreating an xarray dataset from a deep learning model's output, which can be used for further analysis or visualization.
1210

1311
## Motivation
1412

15-
(Add a few sentences stating why this cookbook will be useful. What skills will you, "the chef", gain once you have reached the end of the cookbook?)
13+
This cookbook will be useful for data scientists and machine learning practitioners who want to leverage the power of `xarray` and `xbatcher` for their deep learning workflows. By the end of this cookbook, you will have gained skills in loading and processing Xarray datasets into a format suitable for deep learning using `xbatcher` and furthermore, you will learn how to recreate an Xarray dataset from the output of a deep learning model.
1614

1715
## Authors
1816

19-
[First Author](https://github.com/first-author1), [Second Author](https://github.com/second-author2), etc. _Acknowledge primary content authors here_
17+
[Keenan Ganz](https://github.com/s-kganz), [Nabin Kalauni](https://github.com/nkalauni)
2018

2119
### Contributors
2220

23-
<a href="https://github.com/ProjectPythia/cookbook-template/graphs/contributors">
24-
<img src="https://contrib.rocks/image?repo=ProjectPythia/cookbook-template" />
21+
<a href="https://github.com/ProjectPythia/xbatcher-deep-learning/graphs/contributors">
22+
<img src="https://contrib.rocks/image?repo=ProjectPythia/xbatcher-deep-learning" />
2523
</a>
2624

2725
## Structure
2826

29-
(State one or more sections that will comprise the notebook. E.g., _This cookbook is broken up into two main sections - "Foundations" and "Example Workflows."_ Then, describe each section below.)
27+
This cookbook is broken up into two main sections - "xbatcher Fundamentals" and "Example Workflow". The first section covers the foundational concepts and tools needed to work with `xbatcher` and `xarray`, while the second section provides a practical example of how to use these tools in a complete end-to-end workflow.
3028

31-
### Section 1 ( Replace with the title of this section, e.g. "Foundations" )
29+
### xbatcher Fundamentals
3230

33-
(Add content for this section, e.g., "The foundational content includes ... ")
31+
The foundational content includes an overview of `xbatcher`, its key features, and how it integrates with `xarray` for efficient data handling in deep learning workflows. The first chapter covers using xbatcher to create batches of data from an `xarray` dataset whereas the second chapter focuses on recreating an `xarray` dataset from the output of a deep learning model.
3432

35-
### Section 2 ( Replace with the title of this section, e.g. "Example workflows" )
33+
### Example Workflow
3634

37-
(Add content for this section, e.g., "Example workflows include ... ")
35+
Example workflow includes using `xbatcher` to create batches of data from an `xarray` dataset (ASTER Global Digital Elevation model), training an Autoencoder on this data, and then using `xbatcher` again to reassemble the model's output into a new `xarray` dataset.
3836

3937
## Running the Notebooks
4038

@@ -53,7 +51,7 @@ on the rocket ship icon, (see figure below), and be sure to select
5351
notebook that you can interact with. I.e. you’ll be able to execute
5452
and even change the example programs. You’ll see that the code cells
5553
have no output at first, until you execute them by pressing
56-
{kbd}`Shift`\+{kbd}`Enter`. Complete details on how to interact with
54+
<kbd>Shift</kbd>+<kbd>Enter</kbd>. Complete details on how to interact with
5755
a live Jupyter notebook are described in [Getting Started with
5856
Jupyter](https://foundations.projectpythia.org/foundations/getting-started-jupyter).
5957

@@ -66,22 +64,20 @@ executable book chapter.
6664

6765
If you are interested in running this material locally on your computer, you will need to follow this workflow:
6866

69-
(Replace "cookbook-example" with the title of your cookbooks)
70-
71-
1. Clone the `https://github.com/ProjectPythia/cookbook-example` repository:
67+
1. Clone the `https://github.com/ProjectPythia/xbatcher-deep-learning` repository:
7268

7369
```bash
74-
git clone https://github.com/ProjectPythia/cookbook-example.git
70+
git clone https://github.com/ProjectPythia/xbatcher-deep-learning.git
7571
```
7672

77-
1. Move into the `cookbook-example` directory
73+
1. Move into the `xbatcher-deep-learning` directory
7874
```bash
79-
cd cookbook-example
75+
cd xbatcher-deep-learning
8076
```
8177
1. Create and activate your conda environment from the `environment.yml` file
8278
```bash
8379
conda env create -f environment.yml
84-
conda activate cookbook-example
80+
conda activate cookbook-dev
8581
```
8682
1. Move into the `notebooks` directory and start up Jupyterlab
8783
```bash

_gallery_info.yml

Lines changed: 6 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -1,6 +1,9 @@
1-
thumbnail: thumbnail.png
1+
thumbnail: tensor_workflow.png
22
tags:
33
domains:
4-
- sampledomain
4+
- deep learning
5+
- earth science
56
packages:
6-
- samplepackage
7+
- xarray
8+
- xbatcher
9+
- pytorch

environment.yml

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -13,3 +13,4 @@ dependencies:
1313
- xbatcher
1414
- rioxarray
1515
- tqdm
16+
- pytest

notebooks/how-to-cite.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -2,6 +2,6 @@
22

33
The material in this Project Pythia Cookbook is licensed for free and open consumption and reuse. All code is served under [Apache 2.0](https://www.apache.org/licenses/LICENSE-2.0), while all non-code content is licensed under [Creative Commons BY 4.0 (CC BY 4.0)](https://creativecommons.org/licenses/by/4.0/). Effectively, this means you are free to share and adapt this material so long as you give appropriate credit to the Cookbook authors and the Project Pythia community.
44

5-
The source code for the book is [released on GitHub](https://github.com/ProjectPythia/cookbook-template) and archived on Zenodo. This DOI will always resolve to the latest release of the book source:
5+
The source code for the book is [released on GitHub](https://github.com/ProjectPythia/xbatcher-deep-learning) and archived on Zenodo. This DOI will always resolve to the latest release of the book source:
66

77
[![DOI](https://zenodo.org/badge/475509405.svg)](https://zenodo.org/badge/latestdoi/475509405)

thumbnails/tensor_workflow.png

1.09 MB
Loading

0 commit comments

Comments
 (0)