用扩展现实提升人机协作中人类对机器人行动的实时掌控力
Extended Reality as a Mediation Layer for Situated Human Control in Human-Robot Teaming

- 将XR视为人机协同中的情境化控制中介层
- 提出四类中介功能与六项设计维度,增强控制可感知性
- 适合研究人机交互、智能医疗、柔性制造系统的学者
扩展现实(XR)在人机交互中被用于传递机器人意图、规划动作、可达性及状态信息。本文主张,XR还应被视为人机协同中情境化人类控制的中介层。情境化人类控制指人类合作者在具体物理、社会与时间背景下,理解、塑造、授权或中断机器人行为的能力。基于护理辅助、多机械臂监督控制及分心状态下的协作装配等场景,我们指出:当人员移动、目标变化、感知不全、控制角色转换或计划失效时,机器人自主性必须保持可检查与可调整。文中识别出四类中介功能,连接人类意图与机器人自主性、机器人规划与人类判断、共享控制层级,以及团队角色、交接与恢复机制。在此基础上,提炼出六个设计维度:共同行动可能性、社会物理约束、不确定性与计划有效性、多模态控制与修正、角色/交接/问责,以及前瞻式恢复。论文勾勒了面向动态共存环境的可操作、可问责机器人自主性的研究蓝图。
原文摘要 · Abstract (English)
Extended Reality (XR) is increasingly used in human-robot interaction to communicate robot intent, planned motion, reachability, and state. We argue that XR should also be understood as a mediation layer for situated human control in human-robot teaming. Situated human control denotes the human collaborator's ability to understand, shape, authorize, and interrupt robot action within the concrete physical, social, and temporal context in which that action unfolds. We ground this perspective in scenarios from robot-assisted bedside nursing, multi-arm supervisory control, and collaborative assembly under divided attention. Across these scenarios, robot autonomy must remain inspectable and adjustable as people move, goals change, sensing is incomplete, control roles shift, and plans become invalid. We identify four mediation functions connecting human intent and robot autonomy, robot plans and human judgment, levels of shared control, and team roles, handover, and recovery. Building on these functions, we derive six design dimensions: joint action possibilities, socio-physical constraints, uncertainty and plan validity, multimodal control and correction, roles, handover, and accountability, and anticipatory recovery. The paper outlines a research agenda for XR systems that make robot autonomy more actionable and accountable in dynamic shared environments.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。