arXiv:2607.14123cs.LGcs.AI2026-07中稿 · ICML被引 2

解释性AI需从零散方法转向系统性设计,让解释真正推动决策。

Position: Explainability Research Must Prioritize Foundations over Ad-hoc Methods

论文配图:Position: Explainability Research Must Prioritize Foundations over Ad-hoc Methods
图 1 · 摘自论文原文
  • 从零散解释技术转向构建可嵌入闭环系统的结构性框架
  • 实证分析显示多数研究缺乏明确问题定义与评估标准
  • 适合关注可落地解释系统的研究人员和工程师

尽管可解释人工智能(XAI)技术层出不穷——从特征归因到稀疏自编码器——但这些解释在实际工作中很少产生影响,常被生成后即丢弃,无法引导具体行动。这一差距源于基础性缺陷:当前研究尚未建立将解释集成到端到端、人机协同系统中的方法论。本文主张机器学习界应从零散的XAI方法转向解决根本性问题,包括模糊的问题设定、未明确定义的评估目标,以及缺乏解释驱动反馈的流程。通过分析ICML、NeurIPS和ICLR近年论文,并调研XAI从业者,我们揭示了阻碍持续进步的共性问题。最后提出一份实用检查清单,旨在推动XAI向以人为中心、行动导向的方向演进。强调基础清晰性而非堆砌新方法,为实现可操作、反馈驱动的智能系统提供路线图。

原文摘要 · Abstract (English)

Despite the proliferation of Explainable AI (XAI) techniques -- from feature attributions to sparse autoencoders -- explanations rarely influence real-world workflows. In practice, they are often generated and discarded without guiding meaningful action. This gap reflects foundational shortcomings: research has not yet established methodologies for integrating explanations into end-to-end, human-in-the-loop systems. This position paper argues that the machine learning community must pivot from ad-hoc XAI methods toward addressing foundational & structural challenges, including unclear problem formulations, underspecified evaluation objectives, and the absence of pipelines for explanation-driven feedback. We support this claim through an analysis of recent ICML, NeurIPS, and ICLR papers and a survey of XAI practitioners, revealing recurring issues that limit cumulative progress. We conclude by outlining a practical checklist designed to shift XAI toward a more human-centered, action-oriented paradigm. By emphasizing foundational clarity over the development of ad-hoc methods, we hope to provide a roadmap for integrating explanations into actionable, feedback-driven AI systems.

可解释AI人机协同系统设计

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。