用脑电、视线和手部动作预测机器人协作中的交接意图,提前识别更准确。
Early Detection of Human Handover Intentions in Human-Robot Collaboration: Comparing EEG, Gaze, and Hand Motion
- 对比脑电、视线和手部动作三类信号检测交接意图。
- 视线信号最早且最准,可提前识别是否要交接物品。
- 首次在相同实验中系统比较多模态意图识别效果。
人机协作(HRC)依赖于对人类意图的精准及时识别以实现顺畅交互。在常见任务中,物体交接已被广泛研究,用于规划机器人接收物品的动作,但区分交接意图与其他动作的研究仍有限。现有研究多依赖视觉检测运动轨迹,当轨迹重叠时易导致延迟或误判。本文探究交接意图是否体现在非运动类生理信号中。通过多模态分析,比较脑电(EEG)、视线与手部运动信号的表现,旨在区分交接意图与非交接动作,在动作启动前与后进行预测与分类。我们基于三种模态构建并评估了意图检测器,比较其准确性与时序表现。据我们所知,这是首个在同一人机交接实验场景下系统开发并测试多模态意图检测器的研究。分析表明,三种信号均能反映交接意图,其中视线信号最早且分类最准确。
原文摘要 · Abstract (English)
Human-robot collaboration (HRC) relies on accurate and timely recognition of human intentions to ensure seamless interactions. Among common HRC tasks, human-to-robot object handovers have been studied extensively for planning the robot's actions during object reception, assuming the human intention for object handover. However, distinguishing handover intentions from other actions has received limited attention. Most research on handovers has focused on visually detecting motion trajectories, which often results in delays or false detections when trajectories overlap. This paper investigates whether human intentions for object handovers are reflected in non-movement-based physiological signals. We conduct a multimodal analysis comparing three data modalities: electroencephalogram (EEG), gaze, and hand-motion signals. Our study aims to distinguish between handover-intended human motions and non-handover motions in an HRC setting, evaluating each modality's performance in predicting and classifying these actions before and after human movement initiation. We develop and evaluate human intention detectors based on these modalities, comparing their accuracy and timing in identifying handover intentions. To the best of our knowledge, this is the first study to systematically develop and test intention detectors across multiple modalities within the same experimental context of human-robot handovers. Our analysis reveals that handover intention can be detected from all three modalities. Nevertheless, gaze signals are the earliest as well as the most accurate to classify the motion as intended for handover or non-handover.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。