无需外接设备,机器人可自动估算人类注视方向。
Gaze estimation learning architecture as support to affective, social and cognitive studies in natural human-robot interaction
- 基于机器人传感器构建学习架构,实现无外部设备的注视估计。
- 在桌面对话场景中,对24名参与者进行多条件标注数据采集。
- 适用于临床等非实验室环境,提升人机互动研究的自然性。
注视是人际互动中的关键社交线索,驱动社会认知机制(如共同注意、意图预测、协作任务)。注视方向反映社会与情感状态,影响情绪感知。研究表明,具备社交能力的具身人形机器人可作为复杂刺激,揭示人类社会认知机制,并提升参与度与生态有效性。然而,仅依赖机器人自身传感器实现人类注视方向的自动估计仍具挑战。本文提出一种学习型机器人架构,在桌面交互场景中无需外部硬件即可估算人类注视方向。桌面任务广泛用于实验心理学研究,便于实现多种协作场景并保持面对面互动。该架构能为外部设备可能干扰自发行为的研究提供支持,尤其适用于实验室以外的非受控环境(如临床场景)。为此,研究还基于人形机器人iCub收集了包含24名参与者在不同注视条件下标注的全新数据集。
原文摘要 · Abstract (English)
Gaze is a crucial social cue in any interacting scenario and drives many mechanisms of social cognition (joint and shared attention, predicting human intention, coordination tasks). Gaze direction is an indication of social and emotional functions affecting the way the emotions are perceived. Evidence shows that embodied humanoid robots endowing social abilities can be seen as sophisticated stimuli to unravel many mechanisms of human social cognition while increasing engagement and ecological validity. In this context, building a robotic perception system to automatically estimate the human gaze only relying on robot's sensors is still demanding. Main goal of the paper is to propose a learning robotic architecture estimating the human gaze direction in table-top scenarios without any external hardware. Table-top tasks are largely used in many studies in experimental psychology because they are suitable to implement numerous scenarios allowing agents to collaborate while maintaining a face-to-face interaction. Such an architecture can provide a valuable support in studies where external hardware might represent an obstacle to spontaneous human behaviour, especially in environments less controlled than the laboratory (e.g., in clinical settings). A novel dataset was also collected with the humanoid robot iCub, including images annotated from 24 participants in different gaze conditions.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。