arXiv:2503.09849cs.HCcs.AI2025-03ICRA

用虚拟观众界面提升人机协作任务中的情境感知能力

Training Human-Robot Teams by Improving Transparency Through a Virtual Spectator Interface

  • 通过视觉反馈的虚拟观众界面辅助复盘训练
  • 使用该界面后情境感知提升显著优于录像和口头描述
  • 适合需要增强人机协同理解力的训练场景

事后分析(AAR)是专业人士通过与同伴或专家讨论已完成任务来提升表现的重要方式。以往研究多聚焦于人类团队,但引入机器人队友后,理解意图与沟通面临新挑战,传统人-人复盘难以满足人机团队需求。为此,本文提出一种名为虚拟观众界面(VSI)的新训练复盘(TR)工具,用于提升模拟搜救任务中的人机团队表现与情境意识(SA)。VSI主要通过视觉反馈回顾受试者行为。为验证其有效性,我们借鉴AAR要素设计了1×3组间实验,对比三种条件:(1)使用VSI,(2)屏幕录像,(3)无技术(仅口头描述)。结果表明,虽然VSI未显著提升团队绩效,但相较于其他条件,显著提升了受试者的处境意识(SA)。

原文摘要 · Abstract (English)

After-action reviews (AARs) are professional discussions that help operators and teams enhance their task performance by analyzing completed missions with peers and professionals. Previous studies that compared different formats of AARs have mainly focused on human teams. However, the inclusion of robotic teammates brings along new challenges in understanding teammate intent and communication. Traditional AAR between human teammates may not be satisfactory for human-robot teams. To address this limitation, we propose a new training review (TR) tool, called the Virtual Spectator Interface (VSI), to enhance human-robot team performance and situational awareness (SA) in a simulated search mission. The proposed VSI primarily utilizes visual feedback to review subjects' behavior. To examine the effectiveness of VSI, we took elements from AAR to conduct our own TR, designed a 1 x 3 between-subjects experiment with experimental conditions: TR with (1) VSI, (2) screen recording, and (3) non-technology (only verbal descriptions). The results of our experiments demonstrated that the VSI did not result in significantly better team performance than other conditions. However, the TR with VSI led to more improvement in the subjects SA over the other conditions.

人机协作情境意识训练评估

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。