Back To Index Previous Article Next Article Full Text


Statistica Sinica 22 (2012), 1479-1506

doi:http://dx.doi.org/10.5705/ss.2010.203





ORACLE MODEL SELECTION FOR NONLINEAR MODELS

BASED ON WEIGHTED COMPOSITE

QUANTILE REGRESSION


Xuejun Jiang, Jiancheng Jiang and Xinyuan Song


Zhongnan University of Economics and Law,
University of North Carolina at Charlotte
and The Chinese University of Hong Kong


Abstract: In this paper we propose a weighted composite quantile regression (WCQR) estimation approach and study model selection for nonlinear models with a diverging number of parameters. The WCQR is augmented using a data-driven weighting scheme. With the error distribution unspecified, the proposed estimators share robustness from quantile regression and achieve nearly the same efficiency as the oracle maximum likelihood estimator for a variety of error distributions including the normal, mixed-normal, Student's t, Cauchy distributions, etc. Based on the proposed WCQR, we use the adaptive-LASSO and SCAD regularization to simultaneously estimate parameters and select models. Under regularity conditions, we establish asymptotic equivalency of the two model selection methods and show that they perform as well as if the correct submodels are known in advance. We also suggest an algorithm for fast implementation of the proposed methodology. Simulations are conducted to compare different estimators, and an example is used to illustrate their performance.



Key words and phrases: Adaptive WCQR, adaptive LASSO, high dimensionality, model selection, oracle property, SCAD.

Back To Index Previous Article Next Article Full Text