Back To Index Previous Article Next Article Full Text


Statistica Sinica 22 (2012), 1403-1426

doi:http://dx.doi.org/10.5705/ss.2010.298





SEMIPARAMETRIC REGRESSION PURSUIT


Jian Huang, Fengrong Wei and Shuangge Ma


University of Iowa, University of West Georgia and Yale University


Abstract: The semiparametric partially linear model allows flexible modeling of covariate effects on the response variable in regression. It combines the flexibility of nonparametric regression and the parsimony of linear regression. The most important assumption in the existing methods for the estimation in this model is that a priori it is known which covariates have a linear effect and which do not. However, in applied work, this is rarely known in advance. We consider the problem of estimation in the partially linear models without assuming a priori which covariates have linear effects. We propose a semiparametric regression pursuit method for identifying the covariates with a linear effect. Our proposed method is a penalized regression approach using a group minimax concave penalty. Under suitable conditions we show that the proposed approach is model-pursuit consistent, meaning that it can correctly determine which covariates have a linear effect and which do not with high probability. The performance of the proposed method is evaluated using simulation studies that support our theoretical results. A data example is used to illustrated the application of the proposed method.



Key words and phrases: Group selection, minimax concave penalty, model-pursuit consistency, penalized regression, semiparametric models, structure estimation.

Back To Index Previous Article Next Article Full Text