用分层矩阵可视化解析上万条规则的树集成模型,兼顾常见与异常规则。
RuleExplorer: A Scalable Matrix Visualization for Understanding Tree Ensemble Classifiers
- 将数万条规则按层次结构组织,避免传统降维导致的信息丢失。
- 设计异常规则优先的降维方法,确保稀有但关键规则不被忽略。
- 矩阵式分层可视化支持多粒度探索,适合模型解释与故障分析。
树集成分类器凭借大量规则实现高性能,但也因此难以理解。现有方法通过模型压缩提取规则子集以提升可解释性,但常因忽略罕见却关键的异常规则而损失准确性。本文提出一种可扩展的可视化分析方法,用于解释包含数万条规则的树集成模型。核心思想是通过自适应构建规则层次结构替代规则压缩,保持模型完整性;同时开发异常导向的模型压缩方法,在每一层级优先保留异常规则。结合层次化规则组织,设计基于矩阵的分层可视化界面,支持不同细节级别的探索。定量实验与案例研究验证了该方法能深入理解常规与异常规则,显著提升可解释性且不牺牲全面性。
原文摘要 · Abstract (English)
The high performance of tree ensemble classifiers benefits from a large set of rules, which, in turn, makes the models hard to understand. To improve interpretability, existing methods extract a subset of rules for approximation using model reduction techniques. However, by focusing on the reduced rule set, these methods often lose fidelity and ignore anomalous rules that, despite their infrequency, play crucial roles in real-world applications. This paper introduces a scalable visual analysis method to explain tree ensemble classifiers that contain tens of thousands of rules. The key idea is to address the issue of losing fidelity by adaptively organizing the rules as a hierarchy rather than reducing them. To ensure the inclusion of anomalous rules, we develop an anomaly-biased model reduction method to prioritize these rules at each hierarchical level. Synergized with this hierarchical organization of rules, we develop a matrix-based hierarchical visualization to support exploration at different levels of detail. Our quantitative experiments and case studies demonstrate how our method fosters a deeper understanding of both common and anomalous rules, thereby enhancing interpretability without sacrificing comprehensiveness.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。