Skip to content

Commit c7d0d98

Browse files
authored
Merge pull request #282 from elseml/dev
Add reference to SBC interpretation guide in starter examples (#236)
2 parents fc86d4d + cee86fc commit c7d0d98

File tree

3 files changed

+335
-301
lines changed

3 files changed

+335
-301
lines changed

examples/Linear_Regression.ipynb

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1006,7 +1006,7 @@
10061006
"cell_type": "markdown",
10071007
"metadata": {},
10081008
"source": [
1009-
"The histograms don't look ideal yet but also not too bad. Inference on the intercept $\\beta_0$ is a bit underconfident. That is, the approximate posteriors are a bit wider than the corresponding correct posteriors. The SBC histograms have some drawbacks on how the confidence bands are computed, so we recommend using another kind of plot that is based on the empirical cumulative distribution function (ECDF). For the ECDF, we can compute better confidence bands than for histograms, to the SBC ECDF plot is usually preferable."
1009+
"The histograms don't look ideal yet but also not too bad. Inference on the intercept $\\beta_0$ is a bit underconfident. That is, the approximate posteriors are a bit wider than the corresponding correct posteriors. The SBC histograms have some drawbacks on how the confidence bands are computed, so we recommend using another kind of plot that is based on the empirical cumulative distribution function (ECDF). For the ECDF, we can compute better confidence bands than for histograms, so the SBC ECDF plot is usually preferable. [This SBC interpretation guide by Martin Modrák](https://hyunjimoon.github.io/SBC/articles/rank_visualizations.html) gives further background information and also practical examples of how to interpret the SBC plots."
10101010
]
10111011
},
10121012
{

examples/Quickstart_Amortized_Posterior_Estimation.ipynb

Lines changed: 330 additions & 297 deletions
Large diffs are not rendered by default.

examples/TwoMoons_StarterNotebook.ipynb

Lines changed: 4 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -947,7 +947,8 @@
947947
"The posterior looks as we have expected in this case. However, in general, we do not know how the posterior is supposed to look like for any specific dataset. As such, we need diagnostics that validate the correctness of the inferred posterior. One such diagnostic is simulation-based calibration(SBC), which we can apply for free due to amortization. For more details on SBC and diagnostic plots, see:\n",
948948
"\n",
949949
"1. Talts, S., Betancourt, M., Simpson, D., Vehtari, A., & Gelman, A. (2018). Validating Bayesian inference algorithms with simulation-based calibration. *arXiv preprint*.\n",
950-
"2. Säilynoja, T., Bürkner, P. C., & Vehtari, A. (2022). Graphical test for discrete uniformity and its applications in goodness-of-fit evaluation and multiple sample comparison. *Statistics and Computing*."
950+
"2. Säilynoja, T., Bürkner, P. C., & Vehtari, A. (2022). Graphical test for discrete uniformity and its applications in goodness-of-fit evaluation and multiple sample comparison. *Statistics and Computing*.\n",
951+
"3. The practical SBC interpretation guide by Martin Modrák: https://hyunjimoon.github.io/SBC/articles/rank_visualizations.html"
951952
]
952953
},
953954
{
@@ -963,7 +964,7 @@
963964
],
964965
"metadata": {
965966
"kernelspec": {
966-
"display_name": "Python 3 (ipykernel)",
967+
"display_name": "bf2",
967968
"language": "python",
968969
"name": "python3"
969970
},
@@ -977,7 +978,7 @@
977978
"name": "python",
978979
"nbconvert_exporter": "python",
979980
"pygments_lexer": "ipython3",
980-
"version": "3.11.5"
981+
"version": "3.11.9"
981982
},
982983
"toc": {
983984
"base_numbering": 1,

0 commit comments

Comments
 (0)