用VR可视化机器人导航决策,让普通人看懂它为何这样走。
Immersive Explainability: Visualizing Robot Navigation Decisions through XAI Semantic Scene Projections in Virtual Reality
- 将XAI attributions映射到场景中,用颜色突出重要物体
- 非专家用户理解力提升,对机器人行为预测更准确
- 结合激光雷达图和解释信息,适合人机交互研究者
端到端机器人策略通过强化学习训练的神经网络实现高性能,但其黑箱特性与抽象推理使人类难以理解与预测机器人的导航决策,阻碍信任建立。本文提出一种虚拟现实(VR)界面,可视化可解释AI(XAI)输出与机器人的激光雷达感知,以支持对基于强化学习导航行为的直观解读。通过根据归因得分高亮显示物体,界面将抽象的解释结果与场景语义关联。该可视化桥接了模糊的数值归因分数与面向人类的语义解释层次。24名参与者参与的被试内实验评估了四种结合XAI与激光雷达的可视化条件的有效性。参与者在不同导航场景中按物体对机器人的关键性排序,并完成问卷调查主观理解与可预测性。结果显示,归因分数的语义投影显著提升了非专家用户的客观理解力与主观认知;同时,激光雷达可视化进一步增强了感知可预测性,凸显了融合XAI与传感器信息在构建透明、可信人机交互中的价值。
原文摘要 · Abstract (English)
End-to-end robot policies achieve high performance through neural networks trained via reinforcement learning (RL). Yet, their black box nature and abstract reasoning pose challenges for human-robot interaction (HRI), because humans may experience difficulty in understanding and predicting the robot's navigation decisions, hindering trust development. We present a virtual reality (VR) interface that visualizes explainable AI (XAI) outputs and the robot's lidar perception to support intuitive interpretation of RL-based navigation behavior. By visually highlighting objects based on their attribution scores, the interface grounds abstract policy explanations in the scene context. This XAI visualization bridges the gap between obscure numerical XAI attribution scores and a human-centric semantic level of explanation. A within-subjects study with 24 participants evaluated the effectiveness of our interface for four visualization conditions combining XAI and lidar. Participants ranked scene objects across navigation scenarios based on their importance to the robot, followed by a questionnaire assessing subjective understanding and predictability. Results show that semantic projection of attributions significantly enhances non-expert users' objective understanding and subjective awareness of robot behavior. In addition, lidar visualization further improves perceived predictability, underscoring the value of integrating XAI and sensor for transparent, trustworthy HRI.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。