<div class="csl-bib-body">
<div class="csl-entry">Lipovec, T. (2023). <i>Variational inference for Dirichlet process mixtures and application to Gaussian estimation</i> [Diploma Thesis, Technische Universität Wien]. reposiTUm. https://doi.org/10.34726/hss.2023.107560</div>
</div>
-
dc.identifier.uri
https://doi.org/10.34726/hss.2023.107560
-
dc.identifier.uri
http://hdl.handle.net/20.500.12708/190861
-
dc.description.abstract
Bayesian nonparametric models have emerged as a flexible tool for learning patterns and structures in complex data. A well-known Bayesian nonparametric model is the Dirichlet process mixture (DPM) model. The DPM model extends the Bayesian mixture model with a finite number of mixture components to a Bayesian mixture model with a countably infinite number of mixture components while permitting the use of efficient Bayesian inference methods. Thereby, it becomes possible to cluster data and estimate unknown parameters without specifying the number of clusters and unknown parameters a priori. Practical Bayesian inference methods for DPM models include Markov chain Monte Carlo (MCMC) and variational inference (VI) methods. In this thesis, we focus on the VI methodology and provide a detailed derivation of the coordinate ascent variational inference (CAVI) algorithm for DPM models. Subsequently, we apply the CAVI algorithm to a Gaussian estimation problem that involves noisy observations of object features modeled by a DPM with Gaussian mixture components. We present simulation results that compare the improvement of the estimation accuracy of the object features due to clustering achieved by our CAVI algorithm and by a previously proposed MCMC algorithm. Our simulation results demonstrate to which extent we have to sacrifice estimation accuracy when opting for the less accurate but more efficient CAVI algorithm as opposed to the MCMC algorithm.
en
dc.language
English
-
dc.language.iso
en
-
dc.rights.uri
http://rightsstatements.org/vocab/InC/1.0/
-
dc.subject
Bayesian inference
en
dc.subject
Bayesian estimation
en
dc.subject
Bayesian model
en
dc.subject
Bayesian nonparametrics
en
dc.subject
Dirichlet process
en
dc.subject
Dirichlet process mixture
en
dc.subject
mixture model
en
dc.subject
clustering
en
dc.subject
variational inference
en
dc.subject
variational Bayes
en
dc.subject
statistical signal processing
en
dc.subject
Gaussian mixture
en
dc.subject
probabilistic machine learning
en
dc.subject
exponential family
en
dc.title
Variational inference for Dirichlet process mixtures and application to Gaussian estimation