arXiv:2511.05683cs.HCcs.RO2025-11

用机器人实现虚拟世界中的真实触碰互动,提升沉浸感。

Exploring Immersive Social-Physical Interaction with Virtual Characters through Coordinated Robotic Encountered-Type Contact

  • 通过可动机械臂与虚拟角色进行握手、击掌等物理接触
  • 55人实验验证了虚拟环境中触觉交互的可行性和体验价值
  • 适合研究虚实融合交互、人机共处体验的学者与开发者

本文提出一种新型机器人媒介的沉浸式体验方法,基于遇式触觉显示(ETHD),在虚拟环境中引入直接物理接触。研究聚焦社会-物理交互,即以往人机交互研究中具有重要意义的交互类型。通过物体交接、击拳和击掌三种形式,探索该交互范式在沉浸式虚拟环境中的实现。将此交互范式延伸至虚拟环境,有助于理解物理接触与虚拟增强如何共同塑造新型社会-物理交互体验。为此,我们设计并实现了ETHOS平台,整合力控机械臂与可更换道具,配合头戴式虚拟现实设备,实现基于标记物的物理-虚拟定位,隐藏机器人实体,使接触与可见机器人解耦。通过空间对齐与交互延迟测试进行技术验证,并开展55名参与者用户研究,结果表明该系统在虚拟环境中具备可行性与体验价值,推动动态遇式交互方法在沉浸式人机交互中的进一步发展。

原文摘要 · Abstract (English)

This work presents novel robot-mediated immersive experiences enabled by an encountered-type haptic display (ETHD) that introduces direct physical contact in virtual environments. We focus on social-physical interactions, a class of interaction associated with meaningful human outcomes in prior human-robot interaction (HRI) research. We explore the implementation of this interaction paradigm in immersive virtual environments through an object handover, fist bump, and high five with a virtual character. Extending this HRI paradigm into immersive environments enables the study of how physically grounded robotic contact and virtual augmentation jointly shape these novel social-physical interaction experiences. To support this investigation, we introduce ETHOS (Encountered-Type Haptics for On-demand Social interaction), an experimental platform integrating a torque-controlled manipulator and interchangeable props with a headset-mediated virtual experience. ETHOS enables co-located physical interaction through marker-based physical-virtual registration while concealing the robot behind the virtual environment, decoupling contact from visible robot embodiment. Both technical characterization, through spatial alignment and interaction latency tests, and experiential evaluation, through a 55 participant user study, were completed. Overall, the findings demonstrate the feasibility and experiential value of robot-mediated social-physical interaction in VR and motivate further development of dynamic encountered-type approaches for immersive HRI.

人机交互虚拟现实触觉反馈机器人交互

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。