让模型既能准确预测又能清晰解释每个特征的贡献。
Neural Additive Experts: Context-Gated Experts for Controllable Model Additivity
- 用动态门控机制整合多个专家网络,灵活处理特征间交互。
- 在真实数据集上提升预测精度,同时保持特征贡献可解释。
- 适合需要高透明度与高性能结合的场景,如医疗、金融决策。
可解释性与准确性之间的权衡仍是机器学习的核心挑战。标准广义加法模型(GAMs)虽能提供明确的特征归因,但其严格的加性结构常限制预测性能。引入特征交互可提高精度,却可能掩盖单个特征的影响。为此,我们提出神经加法专家(NAEs)框架,通过专家混合机制为每个特征学习多个专用网络,并利用动态门控机制融合跨特征信息,从而放宽刚性的加性约束。此外,我们设计了针对性正则化技术,缓解专家预测间的方差,实现从纯加法模型到捕捉复杂特征交互的平滑过渡。理论分析与合成数据实验验证了模型灵活性;在真实数据集上的广泛评估表明,NAEs在预测准确性和特征级可解释性之间实现了最优平衡。代码已开源:https://github.com/Teddy-XiongGZ/NAE。
原文摘要 · Abstract (English)
The trade-off between interpretability and accuracy remains a core challenge in machine learning. Standard Generalized Additive Models (GAMs) offer clear feature attributions but are often constrained by their strictly additive nature, which can limit predictive performance. Introducing feature interactions can boost accuracy yet may obscure individual feature contributions. To address these issues, we propose Neural Additive Experts (NAEs), a novel framework that seamlessly balances interpretability and accuracy. NAEs employ a mixture of experts framework, learning multiple specialized networks per feature, while a dynamic gating mechanism integrates information across features, thereby relaxing rigid additive constraints. Furthermore, we propose targeted regularization techniques to mitigate variance among expert predictions, facilitating a smooth transition from an exclusively additive model to one that captures intricate feature interactions while maintaining clarity in feature attributions. Our theoretical analysis and experiments on synthetic data illustrate the model's flexibility, and extensive evaluations on real-world datasets confirm that NAEs achieve an optimal balance between predictive accuracy and transparent, feature-level explanations. The code is available at https://github.com/Teddy-XiongGZ/NAE.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。