arXiv:2409.11675cs.AI2024-09被引 1

提出可解释的目标识别模型,让人类更容易理解智能体的决策逻辑。

Towards Explainable Goal Recognition Using Weight of Evidence (WoE): A Human-Centered Approach

  • 基于人类认知机制构建解释框架,支持对'为何如此'和'为何非如此'的说明。
  • 在8个基准上验证,显著提升用户对模型的理解力与信任度。
  • 适合需要透明决策的人机协作场景,如执法监控与游戏智能体。

目标识别(GR)旨在从观测序列中推断智能体未显式表达的目标,是人工智能中的关键问题,具有广泛应用场景。传统方法多采用‘最佳解释推理’或归纳法,生成最合理的假设来解释行为。另一些方法则通过使行为符合观察者预期或增强决策过程透明度来提升可解释性。本文聚焦于如何以人类可理解的方式解释GR过程,结合两项人机实验的洞察,提出一个以人类为中心的解释概念框架,并据此开发了可解释目标识别(XGR)模型,能够生成针对‘为何如此’与‘为何非如此’问题的解释。我们在八个GR基准上进行计算评估,并通过三项用户研究验证:第一项测试在推箱子游戏中的解释生成效率;第二项评估同一领域内感知到的可解释性;第三项考察模型在非法捕捞检测中对决策辅助的效果。结果表明,相比基线模型,XGR显著提升了用户的理解、信任与决策能力,凸显其在改善人机协作方面的潜力。

原文摘要 · Abstract (English)

Goal recognition (GR) involves inferring an agent's unobserved goal from a sequence of observations. This is a critical problem in AI with diverse applications. Traditionally, GR has been addressed using 'inference to the best explanation' or abduction, where hypotheses about the agent's goals are generated as the most plausible explanations for observed behavior. Alternatively, some approaches enhance interpretability by ensuring that an agent's behavior aligns with an observer's expectations or by making the reasoning behind decisions more transparent. In this work, we tackle a different challenge: explaining the GR process in a way that is comprehensible to humans. We introduce and evaluate an explainable model for goal recognition (GR) agents, grounded in the theoretical framework and cognitive processes underlying human behavior explanation. Drawing on insights from two human-agent studies, we propose a conceptual framework for human-centered explanations of GR. Using this framework, we develop the eXplainable Goal Recognition (XGR) model, which generates explanations for both why and why not questions. We evaluate the model computationally across eight GR benchmarks and through three user studies. The first study assesses the efficiency of generating human-like explanations within the Sokoban game domain, the second examines perceived explainability in the same domain, and the third evaluates the model's effectiveness in aiding decision-making in illegal fishing detection. Results demonstrate that the XGR model significantly enhances user understanding, trust, and decision-making compared to baseline models, underscoring its potential to improve human-agent collaboration.

目标识别可解释性人机协作

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。