Back To Index Previous Article Next Article Full Text

Statistica Sinica 26 (2016), 235-253
doi:http://dx.doi.org/10.5705/ss.2014.233

ADAPTIVE ESTIMATION WITH PARTIALLY
OVERLAPPING MODELS
Sunyoung Shin1, Jason Fine2 and Yufeng Liu2
1The University of Wisconsin, Madison and
2The University of North Carolina, Chapel Hill

Abstract: In many problems, one has several models of interest that capture key parameters describing the distribution of the data. Partially overlapping models are taken as models in which at least one covariate effect is common to the models. A priori knowledge of such structure enables efficient estimation of all model parameters. However, in practice, this structure may be unknown. We propose adaptive composite M-estimation (ACME) for partially overlapping models using a composite loss function, which is a linear combination of loss functions defining the individual models. Penalization is applied to pairwise differences of parameters across models, resulting in data driven identification of the overlap structure. Further penalization is imposed on the individual parameters, enabling sparse estimation in the regression setting. The recovery of the overlap structure enables more efficient parameter estimation. An oracle result is established. Simulation studies illustrate the advantages of ACME over existing methods that fit individual models separately or make strong a priori assumption about the overlap structure.

Key words and phrases: Composite loss function, lasso, model selection, oracle property, overlapping, penalization, sparsity.

Back To Index Previous Article Next Article Full Text