Skip to content

Commit 3469425

Browse files
committed
DOC More fixes.
1 parent 5fe69d3 commit 3469425

File tree

2 files changed

+3
-3
lines changed

2 files changed

+3
-3
lines changed

docs/source/notebooks/gaussian-mixture-model-advi.ipynb

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -4,7 +4,7 @@
44
"cell_type": "markdown",
55
"metadata": {},
66
"source": [
7-
"# Inference of Gaussian mixture model with ADVI"
7+
"# Gaussian Mixture Model with ADVI"
88
]
99
},
1010
{

docs/source/notebooks/lda-advi-aevb.ipynb

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -813,7 +813,7 @@
813813
"cell_type": "markdown",
814814
"metadata": {},
815815
"source": [
816-
"# Summary\n",
816+
"## Summary\n",
817817
"We have seen that PyMC3 allows us to estimate random variables of LDA, a probabilistic model with latent variables, based on automatic variational inference. Variational parameters of the local latent variables in the probabilistic model are encoded from observations. The parameters of the encoding model, MLP in this example, are optimized with variational parameters of the global latent variables. Once the probabilistic and the encoding models are defined, parameter optimization is done just by invoking a function (`advi_minibatch()`) without need to derive complex update equations. \n",
818818
"\n",
819819
"Unfortunately, the estimation result was not accurate compared to LDA in sklearn, which is based on the conjugate priors and thus not relying on the mean field approximation. To improve the estimation accuracy, some researchers proposed post processings that moves Monte Carlo samples to improve variational lower bound (e.g., Rezende and Mohamed, 2015; Salinams et al., 2015). By implementing such methods on PyMC3, we may achieve more accurate estimation while automated as shown in this notebook. "
@@ -825,7 +825,7 @@
825825
"collapsed": true
826826
},
827827
"source": [
828-
"# References\n",
828+
"## References\n",
829829
"* Kingma, D. P., & Welling, M. (2014). Auto-Encoding Variational Bayes. stat, 1050, 1.\n",
830830
"* Kucukelbir, A., Ranganath, R., Gelman, A., & Blei, D. (2015). Automatic variational inference in Stan. In Advances in neural information processing systems (pp. 568-576).\n",
831831
"* Blei, D. M., Ng, A. Y., & Jordan, M. I. (2003). Latent dirichlet allocation. Journal of machine Learning research, 3(Jan), 993-1022.\n",

0 commit comments

Comments
 (0)