-
-
Notifications
You must be signed in to change notification settings - Fork 1k
Model ranch
On this page we are collecting all the models we might want to use as "anchor models" for the first Pyro release -- that is, models / examples that must perform well before we are happy to release.
The goal is to initially make a tool that makes it easy to do VI with deep generative models. So most of these models should be examples from papers that use VI of one sort or another. (So models that we expect to only work with Monte Carlo methods aren't great candidates for the anchor set... but if we're not sure we should include in the brain storm list and we'll sort through later.)
Some concepts / components to cover with the examples:
- Recognition models
- Local per data point (mean-field) params
- Reparam Elbo estimator
- Discrete variables and their estimators
- IID and time-series
- Non-elbo objectives
Put any model / example that might be an anchor candidate here. We'll sort them out below.
Ideally each example is a model with a target data set and a reference result from a paper.
- VAE
- Classifier
- Bayesian linear/logistic regression; Bayesian neural net
- Semi-supervised classifier
- Some mixture models (which?)
- A model with stochastic recursion (AIR? Grammar?)
- An inverse simulation model?
- LDA?
- DMM?
- VRNN / RVAE?
- Something on ImageNet (to verify scaling)
- Bayesian RL
- Policy gradient
- DRAW
- Some active learning example
- Collaborative filtering
- Probabilistic matrix factorization
- Probabilistic PCA
- Collaborative filtering + deep regression
- Probabilistic matrix factorization
(What models are used as demos in our favorite VI papers? In edward?)