用生理信号实时调节AI解释,提升紧急场景下人机信任
Adaptive XAI in High Stakes Environments: Modeling Swift Trust with Multimodal Feedback in Human AI Teams
- 通过脑电、心率、眼动等信号捕捉用户状态,实现非侵入式反馈
- 构建多目标信任模型,动态调整解释内容以匹配用户压力与情绪
- 适合应急响应、医疗急救等高压力人机协作场景
高效的人机协同严重依赖快速信任,尤其在应急响应等高风险场景中,及时准确的决策至关重要。在时间紧迫且认知负荷高的环境中,自适应可解释性对建立人机信任尤为关键。然而,现有可解释AI方法通常提供统一解释,且严重依赖显式反馈,在高压场景下难以实现。为此,我们提出一种概念性框架——自适应可解释性信任框架(AXTF),通过隐式反馈(如脑电、心率、眼动)实时感知用户认知与情绪状态,动态调节解释内容。核心为多目标个性化信任估计模型,将工作负荷、压力与情绪映射为动态信任值,指导解释特征的调制,从而在人机协作中促进快速信任。该框架为人机协同中自适应、非侵入式XAI系统的设计提供了理论基础。
原文摘要 · Abstract (English)
Effective human-AI teaming heavily depends on swift trust, particularly in high-stakes scenarios such as emergency response, where timely and accurate decision-making is critical. In these time-sensitive and cognitively demanding settings, adaptive explainability is essential for fostering trust between human operators and AI systems. However, existing explainable AI (XAI) approaches typically offer uniform explanations and rely heavily on explicit feedback mechanisms, which are often impractical in such high-pressure scenarios. To address this gap, we propose a conceptual framework for adaptive XAI that operates non-intrusively by responding to users' real-time cognitive and emotional states through implicit feedback, thereby enhancing swift trust in high-stakes environments. The proposed adaptive explainability trust framework (AXTF) leverages physiological and behavioral signals, such as EEG, ECG, and eye tracking, to infer user states and support explanation adaptation. At its core is a multi-objective, personalized trust estimation model that maps workload, stress, and emotion to dynamic trust estimates. These estimates guide the modulation of explanation features enabling responsive and personalized support that promotes swift trust in human-AI collaboration. This conceptual framework establishes a foundation for developing adaptive, non-intrusive XAI systems tailored to the rigorous demands of high-pressure, time-sensitive environments.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。