Skip to content

Commit 74a7ea6

Browse files
committed
adding all spark curricula
1 parent 7c71647 commit 74a7ea6

28 files changed

+1343807
-0
lines changed
Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1 @@
1+
.ipynb_checkpoints/
Lines changed: 7 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,7 @@
1+
up:
2+
docker compose up -d
3+
4+
down:
5+
docker compose down
6+
7+
.PHONY: up down
Lines changed: 15 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,15 @@
1+
# Week 6 Infrastructure Track Spark Training
2+
3+
4+
5+
## Usage
6+
7+
To launch the spark and iceberg docker containers, run:
8+
9+
```bash
10+
make up
11+
```
12+
13+
Then, you should be able to access a Jupyter notebook at `localhost:8888`.
14+
15+
The first notebook to be able to run is the `event_data_pyspark.ipynb` inside the `notebooks` folder.

bootcamp/materials/3-spark-fundamentals/data/devices.csv

Lines changed: 6223 additions & 0 deletions
Large diffs are not rendered by default.

bootcamp/materials/3-spark-fundamentals/data/events.csv

Lines changed: 404815 additions & 0 deletions
Large diffs are not rendered by default.
Lines changed: 41 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,41 @@
1+
mapid,name,description
2+
c93d708f-f206-11e4-a815-24be05e24f7e,Urban,Andesia was the crucible for countless heroes and villains caught in the throes of seething rebellion and righteous excess.
3+
cb251c51-f206-11e4-8541-24be05e24f7e,Raid on Apex 7,This unbroken ring is a symbol of the discovery that shook the galaxy and changed the course of both human and Covenant destiny.
4+
c854e54f-f206-11e4-bddc-24be05e24f7e,March on Stormbreak,
5+
c8d69870-f206-11e4-b477-24be05e24f7e,Escape from A.R.C.,Scientists flocked to this Forerunner excavation in search of new beginnings. What they unearthed will lead to their inevitable end.
6+
73ed1fd0-45e5-4bb9-ab6a-d2852c04ea7d,Osiris,
7+
96c3e3dd-7703-4086-9e64-e3a23932bdc4,Blue Team,
8+
1c4f8e19-b046-4f78-9e2d-959cba84663d,Glassed,
9+
825065cf-df57-42e3-b845-830e7340ea43,Unconfirmed,
10+
9a188f67-1664-4d7b-83ca-1d74f714f764,Alliance,
11+
2702ea83-2c3e-4fd5-8370-60d9a6e0422f,Before the Storm,
12+
82f8471c-a2ef-4089-ac04-7e829fdec912,Genesis,
13+
fcd7caa4-37c9-4365-bdda-9041dc6699ed,The Breaking,
14+
7dc80b62-dd39-41d5-9b7a-d71fd8832c07,Guardians,
15+
db9f76c4-6f9a-4c1a-9b48-7aaf59472ccd,Meridian Station,
16+
b486c8f6-0b00-4a46-b91a-0514969d7c94,Evacuation,
17+
37c717b8-7ae8-4be4-aaa2-945e083bcf3e,Reunion,
18+
72c98d4a-4ee4-40db-baf3-1b1cc3672654,Sword of Sanghelios,
19+
f352eafd-d307-4341-a192-16f7f3f5b43c,Enemy Lines,
20+
8d72dd82-3afb-409e-bee0-512dc97893d2,Battle of Sunaion,
21+
c822b1c0-f206-11e4-9755-24be05e24f7e,Summit,The half-real spaces at the heart of Kamchatka slowly turn over the long march of eons
22+
cae999f0-f206-11e4-9835-24be05e24f7e,Array,Halo erased a hundred billion possibilities to destroy a single inevitability.
23+
c89dae21-f206-11e4-a1c2-24be05e24f7e,Dispatch,
24+
c74c9d0f-f206-11e4-8330-24be05e24f7e,Alpine,These vistas are Forerunner mementos
25+
c7edbf0f-f206-11e4-aa52-24be05e24f7e,Breakout Arena,The broadcast of Breakout matches has proven immensely popular with the UNSC Infinity crew.
26+
cebd854f-f206-11e4-b46e-24be05e24f7e,Coliseum,Forerunner Warrior-Servants tested themselves in this arena before facing the Flood.
27+
cd844200-f206-11e4-9393-24be05e24f7e,Eden,Only now - years after the Human-Covenant War - do many Andesian citizens feel secure enough to return to the metroplex centers.
28+
cdb934b0-f206-11e4-8810-24be05e24f7e,Empire,Military-industrial concerns that power the UNSC war machine are prime targets for Insurrection factions.
29+
cc040aa1-f206-11e4-a3e0-24be05e24f7e,Fathom,The UNSC explores Beta Gabriel’s vast oceans in hopes of recovering wreckage hidden in the crushing depths.
30+
caacb800-f206-11e4-81ab-24be05e24f7e,Plaza,Promesa’s streets were no stranger to organized violence.
31+
cdee4e70-f206-11e4-87a2-24be05e24f7e,Regret,
32+
cb914b9e-f206-11e4-b447-24be05e24f7e,The Rig,Humanity’s ravenous engines of industry require salvaging vast amounts of rare metals from Meridian’s vitrified surface.
33+
ce1dc2de-f206-11e4-a646-24be05e24f7e,Truth,
34+
c7805740-f206-11e4-982c-24be05e24f7e,Glacier,Each of Halo's microclimates can be controlled with exacting precision.
35+
c7b7baf0-f206-11e4-ae9a-24be05e24f7e,Parallax,The Orion Arm of the galaxy teems with danger and opportunity.
36+
c96ff240-f206-11e4-b581-24be05e24f7e,Battle of Noctus,The Andesian government vowed to root the Insurrection from Noctus
37+
ca737f8f-f206-11e4-a7e2-24be05e24f7e,Overgrowth,Nature has reclaimed this tomb of millions.
38+
cbcea2c0-f206-11e4-8c4a-24be05e24f7e,Riptide ,The waters of this planet have receded
39+
cc74f4e1-f206-11e4-ad66-24be05e24f7e,,
40+
ce89a40f-f206-11e4-b83f-24be05e24f7e,,
41+
5e130537-2275-40b5-9758-94b1986934ed,,

bootcamp/materials/3-spark-fundamentals/data/match_details.csv

Lines changed: 151762 additions & 0 deletions
Large diffs are not rendered by default.

bootcamp/materials/3-spark-fundamentals/data/matches.csv

Lines changed: 24026 additions & 0 deletions
Large diffs are not rendered by default.

bootcamp/materials/3-spark-fundamentals/data/medals.csv

Lines changed: 184 additions & 0 deletions
Large diffs are not rendered by default.

0 commit comments

Comments
 (0)