Back To Index Previous Article Next Article Full Text

Statistica Sinica 31 (2021), 843-865

ON THE BETA PRIME PRIOR FOR SCALE PARAMETERS IN
HIGH-DIMENSIONAL BAYESIAN REGRESSION MODELS

Ray Bai and Malay Ghosh

University of South Carolina and University of Florida

Abstract: We study a high-dimensional Bayesian linear regression model in which the scale parameter follows a general beta prime distribution. Under the assumption of sparsity, we show that an appropriate selection of the hyperparameters in the beta prime prior leads to the (near) minimax posterior contraction rate when pn. For finite samples, we propose a data-adaptive method for estimating the hyperparameters based on the marginal maximum likelihood (MML). This enables our prior to adapt to both sparse and dense settings and, under our proposed empirical Bayes procedure, the MML estimates are never at risk of collapsing to zero. We derive an efficient Monte Carlo expectation-maximization (EM) and variational EM algorithm for our model, which are available in the R package NormalBetaPrime. Simulations and an analysis of a gene expression data set illustrate our model's self-adaptivity to varying levels of sparsity and signal strengths.

Key words and phrases: Beta prime density, empirical Bayes, high-dimensional data, posterior contraction, scale mixtures of normal distributions.

Back To Index Previous Article Next Article Full Text