Back To Index Previous Article Next Article Full Text

Statistica Sinica 28 (2018), 1225-1243

SUPERVISED LEARNING VIA
THE “HUBNET” PROCEDURE
Leying Guan, Zhou Fan and Robert Tibshirani
Stanford University

Abstract: We propose a new method for supervised learning. The hubNet procedure fits a hub-based graphical model to the predictors, to estimate the amount of "connection" that each predictor has with other predictors. This yields a set of predictor weights that are then used in a regularized regression such as the lasso or elastic net. The resulting procedure is easy to implement, can often yield higher or competitive prediction accuracy with fewer features than the lasso, and can give insight into the underlying structure of the predictors. HubNet can be generalized seamlessly to supervised problems such as regularized logistic regression (and other GLMs), Cox's proportional hazards model, and nonlinear procedures such as random forests and boosting. We prove recovery results under a specialized model and illustrate the method on real and simulated data.

Key words and phrases: Adaptive lasso, graphical model, hubNet, unsupervised weights.

Back To Index Previous Article Next Article Full Text