arXiv:2504.13899cs.HCcs.AI2025-04中稿 · The 3rd World Conf…被引 2

用人类评分预测反事实解释满意度,发现可操作性和信任感最关键。

Predicting Satisfaction of Counterfactual Explanations from Human Ratings of Explanatory Qualities

  • 基于206人评分数据,分析七项解释质量指标对满意度的影响。
  • 可操作性与信任感是用户满意度最强预测因子,完整性也重要。
  • 适合想提升解释系统用户体验的AI开发者和研究者参考。

反事实解释是可解释AI中的常用方法,通过展示输入微小变化如何导致不同结果来提供可行动洞察。然而,评估其质量仍是开放问题:传统量化指标(如稀疏性、接近度)无法充分反映人类偏好,而用户研究虽有价值但难以扩展。此外,仅依赖整体满意度评分无法深入理解解释有效性的原因。为此,我们分析了由206名参与者评估的反事实解释数据集,他们不仅给出整体满意度评分,还对七项标准(可行性、连贯性、复杂度、可理解性、完整性、公平性、信任)进行打分。建模整体满意度与这些标准的关系后发现,可行性(建议修改的可操作性)和信任(相信修改能达成目标)始终是最强预测因子,完整性也有显著贡献。即使剔除这两项,其余指标仍解释58%的方差,凸显其他解释质量的重要性。复杂度独立于满意度,表明更详细不等于更满意。各项指标间存在强相关性,暗示用户评价存在潜在结构,且人口统计背景显著影响评分模式。这些发现有助于设计适应用户专业水平与领域情境的反事实算法。

原文摘要 · Abstract (English)

Counterfactual explanations are a widely used approach in Explainable AI, offering actionable insights into decision-making by illustrating how small changes to input data can lead to different outcomes. Despite their importance, evaluating the quality of counterfactual explanations remains an open problem. Traditional quantitative metrics, such as sparsity or proximity, fail to fully account for human preferences in explanations, while user studies are insightful but not scalable. Moreover, relying only on a single overall satisfaction rating does not lead to a nuanced understanding of why certain explanations are effective or not. To address this, we analyze a dataset of counterfactual explanations that were evaluated by 206 human participants, who rated not only overall satisfaction but also seven explanatory criteria: feasibility, coherence, complexity, understandability, completeness, fairness, and trust. Modeling overall satisfaction as a function of these criteria, we find that feasibility (the actionability of suggested changes) and trust (the belief that the changes would lead to the desired outcome) consistently stand out as the strongest predictors of user satisfaction, though completeness also emerges as a meaningful contributor. Crucially, even excluding feasibility and trust, other metrics explain 58% of the variance, highlighting the importance of additional explanatory qualities. Complexity appears independent, suggesting more detailed explanations do not necessarily reduce satisfaction. Strong metric correlations imply a latent structure in how users judge quality, and demographic background significantly shapes ranking patterns. These insights inform the design of counterfactual algorithms that adapt explanatory qualities to user expertise and domain context.

可解释AI反事实解释用户满意度评估方法

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。