解释AI不能只看模型内部，要关注人与系统互动中产生的意义。
Emergent, not Immanent: A Baradian Reading of Explainable AI
- 用巴兰德的行动者实在论，把解释看作人、系统、环境共同作用下涌现的结果。
- 批判了现有XAI方法中隐含的因果还原论和解释者超然立场。
- 提出支持动态解释的设计方向，适合关注AI伦理与交互设计的研究者。
可解释AI（XAI）常被当作揭示模型内部运作的技术问题。这一立场受制于未加审视的存在论与认识论假设：意义被视为模型内在属性，解释者被置于系统之外，且认为因果结构可通过计算手段恢复。本文借助巴兰德的行动者实在论，构建了一种替代性的XAI存在论-认识论。我们主张，解释是人、模型、情境与解释工具之间具体纠缠所涌现的物质-话语实践。通过以行动者实在论重读一系列主流XAI方法，我们揭示了其背后的预设与局限。进而阐明该框架的伦理维度，并提出支持涌现式解释的设计方向，以一个虚构的文本转音乐界面为例进行说明。
原文摘要 · Abstract (English)
Explainable AI (XAI) is frequently positioned as a technical problem of revealing the inner workings of an AI model. This position is affected by unexamined onto-epistemological assumptions: meaning is treated as immanent to the model, the explainer is positioned outside the system, and a causal structure is presumed recoverable through computational techniques. In this paper, we draw on Barad's agential realism to develop an alternative onto-epistemology of XAI. We propose that interpretations are material-discursive performances that emerge from situated entanglements of the AI model with humans, context, and the interpretative apparatus. To develop this position, we read a comprehensive set of XAI methods through agential realism and reveal the assumptions and limitations that underpin several of these methods. We then articulate the framework's ethical dimension and propose design directions for XAI interfaces that support emergent interpretation, using a speculative text-to-music interface as a case study.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。