研究机器人操作中视线如何随任务阶段变化,揭示其预测与监控双重作用。
The functional and temporal roles of gaze evolve across the phases and constraints of multi-stage robot-mediated manipulation
- 通过多阶段远程操控实验分析视线行为模式
- 视线始终与任务目标对齐,且在障碍物增多时延迟关注终点
- 适合人机交互设计者理解用户意图的上下文依赖性
目标导向的眼动是视觉运动控制的基础,使人类能够预判并引导行动。因此,它被越来越多地用于人-机器人交互中以推断用户目标。然而,在操作过程中,凝视可能反映未来动作意图,也可能源于对机器人代理的视觉监控,因身体感知发生变化所致。目前尚不清楚预测性与监控性眼动在受约束的多阶段机器人中介操作中的组织方式。本文通过研究目标导向的远程操控中的眼动行为,揭示了在多阶段任务中,当身体感知被改变时,视觉运动控制如何适应。研究发现,尽管存在身体感知的改变,眼动仍与任务目标高度一致,保持其预测功能。同时,视线频繁在机器人的末端执行器和操作对象之间切换,表明在线监控需求增强。障碍物的存在及其几何形状调节了这些凝视的时间分布,当中间约束更严苛时,注意力到达最终目标的时间被延迟。这些结果表明,即使在感知耦合被破坏的情况下,预测性眼动也不会消失,而是根据感觉反馈和控制需求重新组织。更广泛地说,这突显了人类视觉运动系统的灵活性,并提示在人-机器人交互中,应结合上下文解释眼动,而非将每次凝视都视为用户意图的直接证据。
原文摘要 · Abstract (English)
Goal-directed eye movements are a fundamental component of visuomotor control, enabling humans to anticipate and guide their actions. For this reason, they are increasingly used in human-robot interaction to estimate users' goals. However, during manipulation, fixations may reflect either an intended future action or the need to visually monitor the robotic proxy due to altered embodiment. How predictive and monitoring-related gaze are organized across the different phases of a constrained robot-mediated manipulation remains unclear. Here we address this question by investigating gaze behavior during goal-directed telemanipulation to characterize how visuomotor control adapts to altered embodiment in a multi-stage task. Our findings show that gaze remains strongly aligned with task goals, preserving its predictive role even during robot-mediated manipulation. At the same time, gaze frequently alternates between the robotic end-effector and the manipulated object, revealing increasing online monitoring. The presence and geometry of obstacles modulate the timing and distribution of these fixations, delaying attention to the final target when intermediate constraints become more demanding. These findings show that predictive gaze is not lost under altered embodiment but reorganized in response to changes in sensory feedback and control demands. More broadly, they highlight the flexibility of the human visuomotor system when the natural sensorimotor coupling is disrupted and suggest that gaze should be interpreted contextually rather than treating every fixation as direct evidence of user intention in human-robot interaction.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。