提出可控制解释规模的交互感知可解释模型,提升表格数据建模精度。
Complexity-Budgeted, Interaction-Aware Interpretable Model for Tabular Data

- 通过自适应离散化与成对交互评分,识别变量间的协同作用。
- 在40个数据集上平均AUC接近梯度提升模型,解释组件减少14-28倍。
- 适合需要紧凑解释且重视特征交互的场景,如医疗或金融决策。
针对表格数据的可解释分类器通常依赖稀疏特征、规则或模式,但常见的特征筛选步骤会丢弃仅在与其他变量联合配置时才具预测价值的变量。本文提出交互感知可解释机器学习(IAIML)框架,通过三个协同机制解决此问题:自适应每特征离散化、有限网格成对交互评分、分段解释预算。检测到的交互可通过两种策略处理:放宽筛选条件使支持交互的变量进入模式搜索,或为稀疏下游分类器构建显式成对项。在包含24个真实世界表格式基准和16个合成交互压力测试的40个数据集面板上,采用嵌套交叉验证评估,IAIML平均AUC距离调优后的梯度提升集成模型仅差1.4点,同时所需拟合解释组件约为其1/14至1/28。在具有强成对交互结构但边际信号弱的数据集上,IAIML优于所有基线。在紧凑可解释方法中,其AUC和组件数量与RuleFit相当,且调参成本更低。期望边界树(EBM)在全面板上获得小幅但显著的AUC优势,但查找表规模大得多。性能在需高阶交互的数据集上下降。组件隔离消融实验确认自适应离散化与交互感知准入各贡献增量效果。结果表明,IAIML是一种紧凑、交互感知的框架,适用于解释规模受限且需受控处理特征交互的设计需求。
原文摘要 · Abstract (English)
Inherently interpretable classifiers for tabular data typically rely on sparse features, rules, or patterns that users can inspect directly. The marginal feature-screening step common to these methods can discard variables whose predictive value emerges only through joint configurations with other variables. We present Interaction Aware Interpretable Machine Learning (IAIML), a framework that addresses this limitation through three coordinated mechanisms: adaptive per-feature discretization, finite-grid pairwise interaction scoring, and a partitioned explanation budget. Detected interactions are routed through one of two strategies: relaxing the screening filter so that interaction-supported variables enter the pattern search, or constructing explicit pair terms for a sparse downstream classifier. On a 40-dataset panel comprising 24 real-world tabular benchmarks and 16 synthetic interaction stress tests, evaluated under nested cross-validation, IAIML achieves mean AUC within 1.4 points of tuned gradient-boosted ensembles while requiring roughly 14--28 times fewer fitted explanation components. On datasets with strong pairwise interaction structure and low marginal signal, IAIML outperforms all baselines. Among compact interpretable methods, IAIML is comparable to RuleFit in AUC and component count and is less expensive to tune. EBM obtains a small but significant AUC advantage across the full panel, with a substantially larger lookup-table footprint. Performance degrades on datasets requiring higher-order interactions beyond the pairwise scope. Component-isolated ablations confirm that adaptive discretization and interaction-aware admission each contribute incrementally. These results support IAIML as a compact, interaction-aware framework appropriate for settings where bounded explanation size and controlled treatment of feature interactions are design requirements.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。