Skip to content

Commit 4416a53

Browse files
committed
updating Spark readme
1 parent 74a7ea6 commit 4416a53

File tree

1 file changed

+13
-3
lines changed
  • bootcamp/materials/3-spark-fundamentals

1 file changed

+13
-3
lines changed
Lines changed: 13 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -1,15 +1,25 @@
1-
# Week 6 Infrastructure Track Spark Training
1+
# Week 3 Spark Fundamentals training
22

3+
## Unit Testing PySpark Course Getting Started
34

5+
You need to install the required dependencies in `requirements.txt`
46

5-
## Usage
7+
Running `pip install -r requirements.txt` will install them.
68

7-
To launch the spark and iceberg docker containers, run:
9+
Running pytest is easy. You just need to run `pytest` and you're good to go!
10+
11+
12+
13+
## Spark Fundamentals and Advanced Spark Setup
14+
15+
To launch the Spark and Iceberg Docker containers, run:
816

917
```bash
1018
make up
1119
```
1220

21+
Or `docker compose up` if you're on Windows!
22+
1323
Then, you should be able to access a Jupyter notebook at `localhost:8888`.
1424

1525
The first notebook to be able to run is the `event_data_pyspark.ipynb` inside the `notebooks` folder.

0 commit comments

Comments
 (0)