File tree Expand file tree Collapse file tree 3 files changed +35
-0
lines changed
bootcamp/materials/6-data-pipeline-maintenance Expand file tree Collapse file tree 3 files changed +35
-0
lines changed Original file line number Diff line number Diff line change
1
+ # Week 5 Data Pipeline Maintenance
2
+
3
+ ## We cover in this week
4
+
5
+ - Run books, prioritization, etc
6
+ - The tradeoffs of tech debt and business velocity
Original file line number Diff line number Diff line change
1
+ # Week 5 Data Pipeline Maintenance
2
+
3
+ ### Homework
4
+
5
+ Imagine you're in a group of 4 data engineers, you will be in charge of creating the following things:
6
+
7
+ You are in charge of managing these 5 pipelines that cover the following business areas:
8
+
9
+ - Profit
10
+ - Unit-level profit needed for experiments
11
+ - Aggregate profit reported to investors
12
+ - Growth
13
+ - Aggregate growth reported to investors
14
+ - Daily growth needed for experiments
15
+ - Engagement
16
+ - Aggregate engagement reported to investors
17
+
18
+ You are in charge of figuring out the following things:
19
+
20
+ - Who is the primary and secondary owners of these pipelines?
21
+ - What is an on-call schedule that is fair
22
+ - Think about holidays too!
23
+ - Creating run books for all pipelines that report metrics to investors
24
+ - What could potentially go wrong in these pipelines?
25
+ - (you don't have to recommend a course of action though since this is an imaginatione exercise)
26
+
27
+ Create a markdown file submit it!
28
+
29
+
You can’t perform that action at this time.
0 commit comments