Feature Screening for High-Dimensional Variable Selection in Generalized Linear Models. 2023

Jinzhu Jiang, and Junfeng Shang
Department of Mathematics and Statistics, Bowling Green State University, Bowling Green, OH 43403, USA.

The two-stage feature screening method for linear models applies dimension reduction at first stage to screen out nuisance features and dramatically reduce the dimension to a moderate size; at the second stage, penalized methods such as LASSO and SCAD could be applied for feature selection. A majority of subsequent works on the sure independent screening methods have focused mainly on the linear model. This motivates us to extend the independence screening method to generalized linear models, and particularly with binary response by using the point-biserial correlation. We develop a two-stage feature screening method called point-biserial sure independence screening (PB-SIS) for high-dimensional generalized linear models, aiming for high selection accuracy and low computational cost. We demonstrate that PB-SIS is a feature screening method with high efficiency. The PB-SIS method possesses the sure independence property under certain regularity conditions. A set of simulation studies are conducted and confirm the sure independence property and the accuracy and efficiency of PB-SIS. Finally we apply PB-SIS to one real data example to show its effectiveness.

UI MeSH Term Description Entries

Related Publications

Jinzhu Jiang, and Junfeng Shang
January 2013, Stat,
Jinzhu Jiang, and Junfeng Shang
July 2018, Journal of multivariate analysis,
Jinzhu Jiang, and Junfeng Shang
June 2005, Biometrics,
Jinzhu Jiang, and Junfeng Shang
August 2023, Computational statistics & data analysis,
Jinzhu Jiang, and Junfeng Shang
October 2019, Annals of statistics,
Jinzhu Jiang, and Junfeng Shang
January 2011, Annals of statistics,
Jinzhu Jiang, and Junfeng Shang
January 2011, Biostatistics (Oxford, England),
Jinzhu Jiang, and Junfeng Shang
January 2020, Statistica Sinica,
Copied contents to your clipboard!