arXiv:2510.12201cs.AI2025-10综述被引 2

提出以人为中心的可解释AI评估框架,区分用户类型并定制设计目标。

On the Design and Evaluation of Human-centered Explainable AI Systems: A Systematic Review and Taxonomy

  • 区分核心系统与解释模块,构建完整XAI评估体系
  • 提炼出影响用户信任、认知与使用的五类评价指标
  • 为新手与专家用户提供差异化设计指南,提升实用性

随着AI在日常生活中的普及,对既高效又可理解的智能系统的需求日益增长。可解释AI(XAI)旨在提供决策和预测的可理解解释。然而,当前评估多聚焦技术指标,忽视用户实际需求。本文系统回顾了65项跨领域XAI用户研究,提出以人类为中心的XAI系统属性与评估指标全景图。明确区分核心系统与解释模块,将评估指标细分为对系统的感情、认知、可用性、可解释性及解释质量五类。根据用户类型,提出差异化设计目标:对AI新手强调负责任使用、接受度与易用性;对数据专家则聚焦人机协作效率与任务性能。该工作扩展了现有XAI设计与评估框架,为开发者提供实证指导。

原文摘要 · Abstract (English)

As AI becomes more common in everyday living, there is an increasing demand for intelligent systems that are both performant and understandable. Explainable AI (XAI) systems aim to provide comprehensible explanations of decisions and predictions. At present, however, evaluation processes are rather technical and not sufficiently focused on the needs of human users. Consequently, evaluation studies involving human users can serve as a valuable guide for conducting user studies. This paper presents a comprehensive review of 65 user studies evaluating XAI systems across different domains and application contexts. As a guideline for XAI developers, we provide a holistic overview of the properties of XAI systems and evaluation metrics focused on human users (human-centered). We propose objectives for the human-centered design (design goals) of XAI systems. To incorporate users' specific characteristics, design goals are adapted to users with different levels of AI expertise (AI novices and data experts). In this regard, we provide an extension to existing XAI evaluation and design frameworks. The first part of our results includes the analysis of XAI system characteristics. An important finding is the distinction between the core system and the XAI explanation, which together form the whole system. Further results include the distinction of evaluation metrics into affection towards the system, cognition, usability, interpretability, and explanation metrics. Furthermore, the users, along with their specific characteristics and behavior, can be assessed. For AI novices, the relevant extended design goals include responsible use, acceptance, and usability. For data experts, the focus is performance-oriented and includes human-AI collaboration and system and user task performance.

可解释AI用户研究人机交互评估框架

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。