File tree Expand file tree Collapse file tree 1 file changed +28
-1
lines changed Expand file tree Collapse file tree 1 file changed +28
-1
lines changed Original file line number Diff line number Diff line change @@ -21,7 +21,7 @@ aws_access_key_id = {{Key ID}}
2121aws_secret_access_key = {{Access Key}}
2222```
2323
24- ### Setup project
24+ ### Using DVC
2525
2626Download data from the DVC repository(analog to ``` git pull ``` )
2727```
@@ -33,3 +33,30 @@ Reproduces the pipeline using DVC
3333dvc repro
3434```
3535
36+ #### DVC Pipelines
37+
38+
39+ ✂️ Preprocessing pipeline
40+ ```
41+ dvc run -n preprocess -d ./src/preprocess_data.py -d data/weatherAUS.csv \
42+ -o ./data/weatherAUS_processed.csv -o ./data/features.csv \
43+ python3 ./src/preprocess_data.py ./data/weatherAUS.csv
44+ ```
45+
46+
47+ 📘 Training pipeline
48+ ```
49+ dvc run -n train -d ./src/train.py -d ./data/weatherAUS_processed.csv \
50+ -d ./src/model.py \
51+ -o ./models/model.joblib \
52+ python3 ./src/train.py ./data/weatherAUS_processed.csv ./src/model.py 200
53+ ```
54+
55+
56+ 📊 Evaluate pipeline
57+ ```
58+ dvc run -n evaluate -d ./src/evaluate.py -d ./data/weatherAUS_processed.csv \
59+ -d ./src/model.py -d ./models/model.joblib -o ./results/metrics.json \
60+ -o ./results/precision_recall_curve.png -o ./results/roc_curve.png \
61+ python3 ./src/evaluate.py ./data/weatherAUS_processed.csv ./src/model.py ./models/model.joblib
62+ ```
You can’t perform that action at this time.
0 commit comments