Improved simulation-based calibration paper soon! #57
hyunjimoon
started this conversation in
brain belief 🟩
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
Summary is as follows and entire paper will be shared soon.
simulation-based calibration CHECK is the correct name. Any checks using self-consistency property* can be put under this frame.
I was confused about two different checks based on self-consistency property. A. rank-uniformity and B. distribution equivalence of prior and data-averaged posterior. Hazhir's point-mass prior example explains why check B cannot be stronger than check A.
Check A never detecting 'estimator that always returns prior distribution as posterior' was a BIG problem which new SBC check allows users to in principle detect any possible issue with the posterior. This is made possible by including additional data-dependent test (e.g. likelihood) quantities when running SBC.
Beta Was this translation helpful? Give feedback.
All reactions