Shrink Globally, Act Locally: Sparse Bayesian Regularization and Prediction

Nicholas G. Polson, James G. Scott, Bertrand Clarke, C. Severinski

Research output: Chapter in Book/Report/Conference proceedingChapter

13 Scopus citations

Abstract

We study the classic problem of choosing a prior distribution for a location parameter β = (β 1,..., β p) as p grows large. First, we study the standard "global-local shrinkage" approach, based on scale mixtures of normals. Two theorems are presented which characterize certain desirable properties of shrinkage priors for sparse problems. Next, we review some recent results showing how Lévy processes can be used to generate infinite-dimensional versions of standard normal scale-mixture priors, along with new priors that have yet to be seriously studied in the literature. This approach provides an intuitive framework both for generating new regularization penalties and shrinkage rules, and for performing asymptotic analysis on existing models.

Original languageEnglish (US)
Title of host publicationBayesian Statistics 9
PublisherOxford University Press
Volume9780199694587
ISBN (Electronic)9780191731921
ISBN (Print)9780199694587
DOIs
StatePublished - Jan 19 2012

Keywords

  • Lévy processes
  • Shrinkage
  • Sparsity

ASJC Scopus subject areas

  • Mathematics(all)

Fingerprint Dive into the research topics of 'Shrink Globally, Act Locally: Sparse Bayesian Regularization and Prediction'. Together they form a unique fingerprint.

Cite this