arXiv:2607.03839cs.LG2026-07

通过对抗扰动提升高维特征选择的稳定性与鲁棒性

Adversarial LassoNet: Robust Feature Selection via Stability-Driven Sparse Learning

  • 引入输入空间对抗扰动,结合LassoNet的层次稀疏机制
  • 在ColoredMNIST上提升分布外鲁棒性4.4%,特征支持可复现性6.3%
  • 适用于高维数据中需稳定选特征的场景,如医疗筛查

高维机器学习中的稀疏特征选择至关重要,但传统ℓ₁正则方法在观测噪声和虚假相关下易失效,导致特征支撑不稳定、泛化性能下降。尽管对抗训练广泛用于提升模型鲁棒性,其与分层稀疏特征选择的交互仍研究不足。本文提出对抗LassoNet(AdLNet),一种基于稳定性驱动的稀疏特征选择框架,将输入空间对抗扰动与LassoNet的层次稀疏机制相结合。在局部光滑假设下,推导出可计算的一阶对抗近似,并提供类似神经切线核(NTK)的谱分析,揭示扰动训练如何降低梯度集中。在高维SERS数据、六个公开基准数据集及ColoredMNIST上的实验表明,AdLNet在支持稀疏度相近条件下,显著提升分布外鲁棒性4.4%和特征支持可复现性6.3%。在高维肺癌筛查数据集上,测试准确率提升5.3%,AUC提高6.0%。代码与数据集见https://github.com/719573/Adversarial-LassoNet。

原文摘要 · Abstract (English)

Sparse feature selection is critical for high-dimensional machine learning, yet traditional $\ell_1$-regularized methods are often brittle under observational noise and spurious correlations, leading to unstable feature supports and degraded generalization. Although adversarial training has been widely used to improve model robustness, its interaction with hierarchical sparse feature selection remains underexplored. In this work, we propose Adversarial LassoNet (AdLNet), a stability-driven sparse feature selection framework that integrates input-space adversarial perturbations with the hierarchical sparsity mechanism of LassoNet. We derive a tractable first-order adversarial approximation under local smoothness assumptions and provide an NTK-inspired spectral analysis to characterize how perturbation-driven training can reduce gradient concentration. Experiments on high-dimensional SERS data, six public benchmark datasets, and ColoredMNIST show that AdLNet maintains competitive sparse-selection performance while improving out-of-distribution robustness by 4.4\% and feature support reproducibility by 6.3\% under nearly matched support sparsity on ColoredMNIST. On the high-dimensional lung cancer screening dataset, AdLNet achieves a 5.3\% test accuracy gain and a 6.0\% AUC improvement over vanilla LassoNet. Code and dataset are available at https://github.com/719573/Adversarial-LassoNet.

特征选择对抗训练稀疏学习鲁棒性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。