arXiv:2502.19602cs.LG2025-02被引 5

通过分组简化特征交互,让模型既准又透明。

Learning Ensembles of Interpretable Simple Structure

  • 自下而上识别数据子集中的简单结构,降低特征复杂度。
  • 在子组内用简单模型预测,决策边界更符合领域直觉。
  • 适合需要高可解释性的决策支持场景,如运筹优化。

复杂系统中的决策常依赖机器学习模型,但如XGBoost和神经网络等高精度模型常缺乏可解释性。在运筹研究中,理解决策逻辑与决策本身同样重要。传统可解释模型(如决策树、逻辑回归)虽透明,却难以处理复杂特征交互。然而,决策复杂性往往仅存在于特定数据子集中,这些子集中特征交互可被简化为简单结构,使简单模型有效。本文提出一种自下而上的简单结构识别算法,将数据划分为若干可解释的子组(即简单结构),在每组内最小化特征交互,从而在子组内训练简单可解释模型。我们在合成数据上验证了算法鲁棒性,结果表明,基于简单结构的决策边界比全局模型更易理解,且更符合领域直觉。该方法同时提升可解释性与预测准确性,为模型透明性至关重要的应用场景提供了一种系统性框架。

原文摘要 · Abstract (English)

Decision-making in complex systems often relies on machine learning models, yet highly accurate models such as XGBoost and neural networks can obscure the reasoning behind their predictions. In operations research applications, understanding how a decision is made is often as crucial as the decision itself. Traditional interpretable models, such as decision trees and logistic regression, provide transparency but may struggle with datasets containing intricate feature interactions. However, complexity in decision-making stem from interactions that are only relevant within certain subsets of data. Within these subsets, feature interactions may be simplified, forming simple structures where simple interpretable models can perform effectively. We propose a bottom-up simple structure-identifying algorithm that partitions data into interpretable subgroups known as simple structure, where feature interactions are minimized, allowing simple models to be trained within each subgroup. We demonstrate the robustness of the algorithm on synthetic data and show that the decision boundaries derived from simple structures are more interpretable and aligned with the intuition of the domain than those learned from a global model. By improving both explainability and predictive accuracy, our approach provides a principled framework for decision support in applications where model transparency is essential.

可解释性决策支持特征交互模型透明

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。