Fast Moment Estimation for Generalized Latent Dirichlet Models. 2018

Shiwen Zhao, and Barbara E Engelhardt, and Sayan Mukherjee, and David B Dunson
Department of Statistical Science, Duke University, Durham, NC.

We develop a generalized method of moments (GMM) approach for fast parameter estimation in a new class of Dirichlet latent variable models with mixed data types. Parameter estimation via GMM has computational and statistical advantages over alternative methods, such as expectation maximization, variational inference, and Markov chain Monte Carlo. A key computational advantage of our method, Moment Estimation for latent Dirichlet models (MELD), is that parameter estimation does not require instantiation of the latent variables. Moreover, performance is agnostic to distributional assumptions of the observations. We derive population moment conditions after marginalizing out the sample-specific Dirichlet latent variables. The moment conditions only depend on component mean parameters. We illustrate the utility of our approach on simulated data, comparing results from MELD to alternative methods, and we show the promise of our approach through the application to several datasets. Supplementary materials for this article are available online.

UI MeSH Term Description Entries

Related Publications

Shiwen Zhao, and Barbara E Engelhardt, and Sayan Mukherjee, and David B Dunson
November 2013, IEEE transactions on pattern analysis and machine intelligence,
Shiwen Zhao, and Barbara E Engelhardt, and Sayan Mukherjee, and David B Dunson
January 2019, PloS one,
Shiwen Zhao, and Barbara E Engelhardt, and Sayan Mukherjee, and David B Dunson
March 2011, Biometrics,
Shiwen Zhao, and Barbara E Engelhardt, and Sayan Mukherjee, and David B Dunson
February 2024, The British journal of mathematical and statistical psychology,
Shiwen Zhao, and Barbara E Engelhardt, and Sayan Mukherjee, and David B Dunson
January 2011, Journal of computational and graphical statistics : a joint publication of American Statistical Association, Institute of Mathematical Statistics, Interface Foundation of North America,
Shiwen Zhao, and Barbara E Engelhardt, and Sayan Mukherjee, and David B Dunson
January 2012, Systematic biology,
Shiwen Zhao, and Barbara E Engelhardt, and Sayan Mukherjee, and David B Dunson
January 2010, IEEE transactions on neural networks,
Shiwen Zhao, and Barbara E Engelhardt, and Sayan Mukherjee, and David B Dunson
December 2017, Knowledge and information systems,
Shiwen Zhao, and Barbara E Engelhardt, and Sayan Mukherjee, and David B Dunson
February 2015, IEEE transactions on pattern analysis and machine intelligence,
Shiwen Zhao, and Barbara E Engelhardt, and Sayan Mukherjee, and David B Dunson
November 2005, Physical review. E, Statistical, nonlinear, and soft matter physics,
Copied contents to your clipboard!