通过共享决策路径分组,让随机森林的预测逻辑变得可解释。
Forest-Guided Clustering -- Shedding Light into the Random Forest Black Box
- 根据实例共享的决策路径进行聚类,揭示模型内部结构。
- 在基准数据集上准确恢复潜在子类,在生物数据中发现新基因模式。
- 适合需要理解模型决策依据的科研与医疗场景。
随着机器学习模型在敏感领域应用增多,对可解释、可信决策的需求日益增长。尽管随机森林(RF)在表格数据上表现优异且广泛应用,但其集成特性使其难以解释。本文提出森林引导聚类(FGC),一种针对特定模型的可解释方法,通过按共享决策路径分组实例,揭示RF的局部与全局结构。FGC生成符合模型内部逻辑的人类可读聚类,并计算聚类特异与全局特征重要性,推导出支撑预测的决策规则。在基准数据集上,FGC准确恢复了潜在子类结构,优于传统聚类与事后解释方法。应用于急性髓系白血病转录组数据集时,FGC识别出生物学一致的亚群,分离疾病相关信号与混杂因素,并发现已知与新基因表达模式。FGC通过提供超越特征级归因的结构感知洞察,弥合了性能与可解释性之间的差距。
原文摘要 · Abstract (English)
As machine learning models are increasingly deployed in sensitive application areas, the demand for interpretable and trustworthy decision-making has increased. Random Forests (RF), despite their widespread use and strong performance on tabular data, remain difficult to interpret due to their ensemble nature. We present Forest-Guided Clustering (FGC), a model-specific explainability method that reveals both local and global structure in RFs by grouping instances according to shared decision paths. FGC produces human-interpretable clusters aligned with the model's internal logic and computes cluster-specific and global feature importance scores to derive decision rules underlying RF predictions. FGC accurately recovered latent subclass structure on a benchmark dataset and outperformed classical clustering and post-hoc explanation methods. Applied to an AML transcriptomic dataset, FGC uncovered biologically coherent subpopulations, disentangled disease-relevant signals from confounders, and recovered known and novel gene expression patterns. FGC bridges the gap between performance and interpretability by providing structure-aware insights that go beyond feature-level attribution.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。