| description |
|---|
How to evaluate deep learning model? |
{% embed url="https://www.youtube.com/watch?v=wP6BkXcB\_Xg" caption="Evaluate - Troubleshooting" %}
- You want to apply the bias-variance decomposition concept here: Test error = irreducible error + bias + variance + validation overfitting.
- If the training, validation, and test sets come from different data distributions, then you should use 2 validation sets: one set sampled from the training distribution, and the other set sampled from the test distribution.