提出一种双稀疏模型的近端投影方法,提升高维回归效率与稳定性。
Proximal Projection for Doubly Sparse Regularized Models

- 将系数向量分解为节点贡献的潜变量之和,对潜变量施加正则化
- 在不同图结构下表现稳定,计算资源消耗低于传统重复特征法
- 适合处理高维且具图结构的预测变量,如基因表达数据
在高维回归中,正则化常用于生成稀疏模型,节省计算资源并识别与响应变量强相关的预测因子。当预测因子可由高斯图模型表示时,可利用其图结构进行正则化。本文提出的模型通过将估计系数向量分解为对应每个节点贡献的潜变量之和,对潜变量而非系数向量直接施加正则化。采用可明确控制L1与L2惩罚权衡的损失函数,并提出一种新颖的近端投影算法。此外,实现中计算选定组交集的投影算子,相比预测因子复制方法更节省计算资源,尤其适用于高维数据。通过模拟实验评估了不同图结构和节点数量下的性能,并在真实数据上进行了验证。结果表明,该方法在稳定性上优于其他单或双稀疏图回归模型。
原文摘要 · Abstract (English)
Regularization is often used in high-dimensional regression settings to generate a sparse model, which can save tremendous computing resources and identify predictors that are most strongly associated with the response. When the predictors can be represented by a Gaussian graphical model, the structure of the predictor graph can be exploited during regularization. Our proposed model exploits this underlying predictor graph structure by decomposing the estimated coefficient vector into a sum of latent variables that correspond to the sum of each node contribution to the coefficient vector. Regularization is then performed on the latent variables rather than on the coefficient vector directly. We use a penalty function that permits a clear user-defined trade-off between the L1 and L2 penalties and propose a novel proximal projection during optimization. Further, our implementation computes the projection operator for the intersection of selected groups, which conserves more computing resources compared to predictor duplication methods, especially for high-dimensional data. Through simulation, we evaluate the performance of our approach under different graph structures and node counts, and present results on real-world data. Results suggest that our method exhibits stable performance relative to other singly or doubly sparse graphical regression models.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。