arXiv:2509.23068stat.MLcs.LG2025-09

提出可解释的高维回归模型,能精准识别复杂交互关系。

Sparse Deep Additive Model with Interactions: Enhancing Interpretability and Predictability

  • 基于效应痕迹原理,分三步筛选变量并分离主效应与交互项。
  • 仿真验证可零误报率识别传统方法遗漏的纯交互关系。
  • 适合小样本、高维特征场景下的可解释建模,尤其关注交互结构。

深度学习发展亟需能从小样本中学习、处理高维特征且保持可解释性的个性化模型。为此,我们提出稀疏深度加性交互模型(SDAMI),通过稀疏驱动的特征选择与深度子网络结合,实现灵活函数逼近。核心是效应痕迹原则:高阶交互会在其组成变量上留下可检测的边际痕迹,无需穷举搜索即可发现。SDAMI采用三阶段策略:(1) 筛选具有痕迹的变量,(2) 利用组Lasso分离主效应与交互项,(3) 用专用深度子网络建模各成分。理论分析表明,痕迹仅在测度为零的对称条件下消失,实践中几乎不可能,确保交互项稳定恢复。大量模拟实验显示,SDAMI成功识别出遗传基线方法根本无法捕捉的纯交互关系,以近乎零的误报率恢复复杂效应结构。这些结果确立了SDAMI作为可解释高维回归的原理性框架。

原文摘要 · Abstract (English)

Recent advances in deep learning highlight the need for personalized models that can learn from small samples, handle high-dimensional features, and remain interpretable. To address this, we propose the Sparse Deep Additive Model with Interactions (SDAMI), a framework that combines sparsity-driven feature selection with deep subnetworks for flexible function approximation. Central to SDAMI is the Effect Footprint principle, which posits that higher-order interactions leave detectable marginal traces on constituent variables, enabling their discovery without exhaustive search. SDAMI executes this principle through a three-stage strategy: (1) screening for footprint variables, (2) disentangling main effects from interactions via group lasso, and (3) modeling components with dedicated deep subnetworks. Theoretical analysis confirms that footprints vanish only under measure-zero symmetry conditions that are rare in practice, ensuring consistent interaction recovery. Extensive simulations demonstrate that SDAMI successfully identifies pure interactions that heredity-based baselines fundamentally miss, recovering complex effect structures with near-zero false positive rates. Together, these results position SDAMI as a principled framework for interpretable high-dimensional regression.

可解释模型高维回归交互作用稀疏学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。