XR³让真人操控虚拟机器人实现真实触感互动,降低人机交互实验门槛。
XR$^3$: An Extended Reality Platform for Social-Physical Human-Robot Interaction
- 双头显共处一空间,操作者动作实时映射为虚拟机器人行为。
- 支持触觉同步:操作者可触摸体验者,手部动作通过逆运动学精准还原。
- 可灵活调节非语言信号,适合研究具身化、触觉型人机交互。
社交物理人机交互(spHRI)研究困难:构建并编程多模态机器人成本高、耗时长,而基于VR的原型往往缺乏物理接触,破坏用户的视觉-触觉预期。本文提出XR³,一个共处同一物理空间的双VR头显平台,使参与者与隐藏操作者共享同一环境但体验不同虚拟身份。参与者在共享虚拟环境中面对面看到一个富有表现力的虚拟机器人;其上半身动作、头部与视线行为、面部表情均实时由操作者追踪的肢体和面部信号驱动。由于操作者与参与者共处同一坐标系,操作者可实际触碰参与者,使感知到的机器人触碰与可见的手部动作同步。通过逆运动学将手指与手部动作映射至机器人化身,支持精确接触。除动作重定向外,XR³还支持多种非语言信号的社会性重定向,可在保持物理互动恒定的情况下进行实验调控。本文详述系统设计与校准方法,并通过基于触碰的“巫师之奥兹”实验验证平台有效性,显著降低具身化、接触式机器人行为的原型与评估门槛。
原文摘要 · Abstract (English)
Social-physical human-robot interaction (spHRI) is difficult to study: building and programming robots that integrate multiple interaction modalities is costly and slow, while VR-based prototypes often lack physical contact, breaking users' visuo-tactile expectations. We present XR$^3$, a co-located dual-VR-headset platform for HRI research in which an attendee and a hidden operator share the same physical space while experiencing different virtual embodiments. The attendee sees an expressive virtual robot that interacts face-to-face in a shared virtual environment. In real time, the robot's upper-body motion, head and gaze behavior, and facial expressions are mapped from the operator's tracked limbs and face signals. Because the operator is co-present and calibrated in the same coordinate frame, the operator can also touch the attendee, enabling perceived robot touch synchronized with the robot's visible hands. Finger and hand motion is mapped to the robot avatar using inverse kinematics to support precise contact. Beyond motion retargeting, XR$^3$ supports social retargeting of multiple nonverbal cues that can be experimentally varied while keeping physical interaction constant. We detail the system design and calibration, and demonstrate the platform in a touch-based Wizard-of-Oz study, lowering the barrier to prototyping and evaluating embodied, contact-based robot behaviors.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。