arXiv:2511.05379cs.ROcs.SY2025-11

让虚拟现实中的击掌、递物等互动触感更真实自然

ETHOS: A Robotic Encountered-Type Haptic Display for Social Interaction in Virtual Reality

  • 用可换配件的机械臂动态追踪用户动作,生成实时触觉反馈
  • 击中时刻延迟仅28.5毫秒,位置误差小于1毫米
  • 适合开发沉浸式社交VR应用,兼顾安全与真实感

我们提出ETHOS(遇触型触觉显示),一种动态遇触型触觉显示系统(ETHD),可在虚拟现实(VR)社交交互中实现自然的物理接触,如递物、击掌和碰拳。系统结合扭矩控制机械臂、可更换被动道具(硅胶手模和棒状物)、基于ChArUco板的标记式物理-虚拟定位,以及基于用户头部和手部姿态的安全监控机制。引入两种控制策略:(i) 静态模式,道具固定于与虚拟物体对齐的位置,符合先前基线;(ii) 动态模式,通过指数融合初始中点轨迹与实时手部追踪,持续更新道具位置,为每次交互生成独特接触点。测试显示静态共位精度为5.09 ± 0.94毫米,用户交互中接触时间对齐平均延迟为28.53 ± 31.21毫秒。结果证明在VR中重现有意义社会触觉的可行性。通过集成安全与控制机制,ETHOS为高保真动态人际交互奠定了实用基础。

原文摘要 · Abstract (English)

We present ETHOS (Encountered-Type Haptics for On-demand Social Interaction), a dynamic encountered-type haptic display (ETHD) that enables natural physical contact in virtual reality (VR) during social interactions such as handovers, fist bumps, and high-fives. The system integrates a torque-controlled robotic manipulator with interchangeable passive props (silicone hand replicas and a baton), marker-based physical-virtual registration via a ChArUco board, and a safety monitor that gates motion based on the user's head and hand pose. We introduce two control strategies: (i) a static mode that presents a stationary prop aligned with its virtual counterpart, consistent with prior ETHD baselines, and (ii) a dynamic mode that continuously updates prop position by exponentially blending an initial mid-point trajectory with real-time hand tracking, generating a unique contact point for each interaction. Bench tests show static colocation accuracy of 5.09 +/- 0.94 mm, while user interactions achieved temporal alignment with an average contact latency of 28.53 +/- 31.21 ms across all interaction and control conditions. These results demonstrate the feasibility of recreating socially meaningful haptics in VR. By incorporating essential safety and control mechanisms, ETHOS establishes a practical foundation for high-fidelity, dynamic interpersonal interactions in virtual environments.

虚拟现实触觉反馈机器人交互社交沉浸

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。