arXiv:2603.06251stat.MLcs.LG2026-03

SPPCSO可稳定筛选高维相关数据中的关键变量。

SPPCSO: Adaptive Penalized Estimation Method for High-Dimensional Correlated Data

  • 结合主成分与L1正则,自适应调整压缩系数。
  • 在高噪声下仍能准确区分信号与噪声变量。
  • 适合基因表达等高维相关数据的变量选择。

随着高维相关数据的兴起,多重共线性严重威胁模型稳定性,导致估计不稳和预测精度下降。本文提出单参数主成分选择算子(SPPCSO),将单参数主成分回归与L1正则化结合,通过引入主成分信息自适应调节收缩因子,平衡变量选择与系数估计,确保在高维、高噪声环境下的模型稳定性和鲁棒估计。理论上,该方法具有选择一致性,且估计误差界小于传统惩罚估计方法。大量数值实验表明,SPPCSO在高噪声条件下保持稳定可靠的估计,能准确识别具有组效应结构的高相关噪声数据中的信号变量,有效剔除冗余变量,实现更稳定的变量选择。此外,在基因表达数据分析中成功识别疾病相关基因,展现出强实用性。结果表明,SPPCSO是高维变量选择的理想工具,为建模相关数据提供高效可解释的解决方案。

原文摘要 · Abstract (English)

With the rise of high-dimensional correlated data, multicollinearity poses a significant challenge to model stability, often leading to unstable estimation and reduced predictive accuracy. This work proposes the Single-Parametric Principal Component Selection Operator (SPPCSO), an innovative penalized estimation method that integrates single-parametric principal component regression and $L_{1}$ regularization to adaptively adjust the shrinkage factor by incorporating principal component information. This approach achieves a balance between variable selection and coefficient estimation, ensuring model stability and robust estimation even in high-dimensional, high-noise environments. The primary contribution lies in addressing the instability of traditional variable selection methods when applied to high-noise, high-dimensional correlated data. Theoretically, our method exhibits selection consistency and achieves a smaller estimation error bound compared to traditional penalized estimation approaches. Extensive numerical experiments demonstrate that SPPCSO not only delivers stable and reliable estimation in high-noise settings but also accurately distinguishes signal variables from noise variables in group-effect structured data with highly correlated noise variables, effectively eliminating redundant variables and achieving more stable variable selection. Furthermore, SPPCSO successfully identifies disease-associated genes in gene expression data analysis, showcasing strong practical value. The results indicate that SPPCSO serves as an ideal tool for high-dimensional variable selection, offering an efficient and interpretable solution for modeling correlated data.

变量选择高维数据主成分正则化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。