Spiked Dirichlet Process Priors for Gaussian Process Models. 2010

Terrance Savitsky, and Marina Vannucci
Department of Statistics, Rice University, Houston, TX 77030, USA ; Statistics group, RAND Corporation, Santa Monica, CA 90407, USA.

We expand a framework for Bayesian variable selection for Gaussian process (GP) models by employing spiked Dirichlet process (DP) prior constructions over set partitions containing covariates. Our approach results in a nonparametric treatment of the distribution of the covariance parameters of the GP covariance matrix that in turn induces a clustering of the covariates. We evaluate two prior constructions: the first one employs a mixture of a point-mass and a continuous distribution as the centering distribution for the DP prior, therefore, clustering all covariates. The second one employs a mixture of a spike and a DP prior with a continuous distribution as the centering distribution, which induces clustering of the selected covariates only. DP models borrow information across covariates through model-based clustering. Our simulation results, in particular, show a reduction in posterior sampling variability and, in turn, enhanced prediction performances. In our model formulations, we accomplish posterior inference by employing novel combinations and extensions of existing algorithms for inference with DP prior models and compare performances under the two prior constructions.

UI MeSH Term Description Entries

Related Publications

Terrance Savitsky, and Marina Vannucci
April 2023, Applied radiation and isotopes : including data, instrumentation and methods for use in agriculture, industry and medicine,
Terrance Savitsky, and Marina Vannucci
January 2009, Bayesian analysis,
Terrance Savitsky, and Marina Vannucci
October 2010, IEEE transactions on pattern analysis and machine intelligence,
Terrance Savitsky, and Marina Vannucci
January 2016, Journal of computational and graphical statistics : a joint publication of American Statistical Association, Institute of Mathematical Statistics, Interface Foundation of North America,
Terrance Savitsky, and Marina Vannucci
March 2010, Journal of machine learning research : JMLR,
Terrance Savitsky, and Marina Vannucci
June 2023, Physical and engineering sciences in medicine,
Terrance Savitsky, and Marina Vannucci
November 2021, Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE Engineering in Medicine and Biology Society. Annual International Conference,
Terrance Savitsky, and Marina Vannucci
January 2008, Computational intelligence and neuroscience,
Terrance Savitsky, and Marina Vannucci
December 2011, IEEE transactions on neural networks,
Terrance Savitsky, and Marina Vannucci
January 2016, Journal of biopharmaceutical statistics,
Copied contents to your clipboard!