arXiv:2503.16445cs.HCcs.AI2025-03被引 2

让黑箱模型的多特征交互关系可视觉化,一眼看清复杂决策依据。

FINCH: Locally Visualizing Higher-Order Feature Interactions in Black Box Models

  • 用颜色和高亮展示任意数量特征的局部交互关系
  • 支持对单个样本的高阶特征交互可视化,突破传统单一特征解释局限
  • 适合需要理解模型决策逻辑的开发者与研究人员

在黑箱人工智能模型广泛应用于各行业的背景下,对其决策过程进行可靠解释显得尤为重要。尽管这些模型依赖复杂的特征交互实现精准预测,但多数解释方法仅关注单个特征的重要性,缺乏对多特征间高阶交互的有效可视化能力,现有表示方法难以应对此类挑战。为解决这一问题,本文提出一种面向个体实例的局部解释方法FINCH,采用基于子集的可视化策略,通过颜色与高亮技术生成直观、以用户为中心的交互图示,并提供多种辅助视图帮助用户建立对模型及解释结果的信任。我们在多个案例研究中验证了FINCH的通用性,并通过面向机器学习专家的大规模人机实验,证明其在实用性与助益性方面的优势。该方法可实现对任意数量特征组合的局部高阶交互可视化。

原文摘要 · Abstract (English)

In an era where black-box AI models are integral to decision-making across industries, robust methods for explaining these models are more critical than ever. While these models leverage complex feature interplay for accurate predictions, most explanation methods only assign relevance to individual features. There is a research gap in methods that effectively illustrate interactions between features, especially in visualizing higher-order interactions involving multiple features, which challenge conventional representation methods. To address this challenge in local explanations focused on individual instances, we employ a visual, subset-based approach to reveal relevant feature interactions. Our visual analytics tool FINCH uses coloring and highlighting techniques to create intuitive, human-centered visualizations, and provides additional views that enable users to calibrate their trust in the model and explanations. We demonstrate FINCH in multiple case studies, demonstrating its generalizability, and conducted an extensive human study with machine learning experts to highlight its helpfulness and usability. With this approach, FINCH allows users to visualize feature interactions involving any number of features locally.

模型解释特征交互可视化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。