提出认知模型比较规则与权重解释AI决策的优劣
Rules or Weights? Comparing User Understanding of Explainable AI Techniques with the Cognitive XAI-Adaptive Model
- 构建共用记忆表征的认知模型CoXAM,融合属性、权重与规则
- 实验证明反事实任务更难,树形规则比线性权重更难使用
- 揭示不同场景下解释技术的有效性,助于选择合适XAI方法
规则与权重是常见的可解释人工智能(XAI)技术。然而,如何在二者间选择仍缺乏认知框架支持。在针对正向与反事实决策任务的用户研究中,我们识别出三种XAI方案(权重、规则及其混合)的7种推理策略。为此,我们提出认知XAI自适应模型CoXAM,采用共享记忆表征编码实例属性、线性权重与决策规则,并基于计算理性,在正向与反事实任务中分别权衡效用与推理时间,动态选择推理过程。验证研究表明,CoXAM在拟合人类决策行为方面优于基线机器学习代理模型,成功复现并解释了若干关键实证发现:反事实任务本就更难;决策树规则比线性权重更难回忆与应用;解释有效性依赖于具体数据上下文。此外,模型还识别出最有效的底层推理策略。该工作为加速调试和评估不同XAI技术提供了认知基础。
原文摘要 · Abstract (English)
Rules and Weights are popular XAI techniques for explaining AI decisions. Yet, it remains unclear how to choose between them, lacking a cognitive framework to compare their interpretability. In an elicitation user study on forward and counterfactual decision tasks, we identified 7 reasoning strategies of interpreting three XAI Schemas - weights, rules, and their hybrid. To analyze their capabilities, we propose CoXAM, a Cognitive XAI-Adaptive Model with shared memory representation to encode instance attributes, linear weights, and decision rules. CoXAM employs computational rationality to choose among reasoning processes based on the trade-off in utility and reasoning time, separately for forward or counterfactual decision tasks. In a validation study, CoXAM demonstrated a stronger alignment with human decision-making compared to baseline machine learning proxy models. The model successfully replicated and explained several key empirical findings, including that counterfactual tasks are inherently harder than forward tasks, decision tree rules are harder to recall and apply than linear weights, and the helpfulness of XAI depends on the application data context, alongside identifying which underlying reasoning strategies were most effective. With CoXAM, we contribute a cognitive basis to accelerate debugging and benchmarking disparate XAI techniques.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。