用手腕振动反馈提升手术中手持工具的精准引导
Multimodal Feedback for Handheld Tool Guidance: Combining Wrist-Based Haptics with Augmented Reality
- 结合增强现实与手腕触觉设备,提供方向与状态提示
- 精度达5.8毫米,用户满意度评分88.1,显著优于单一模态
- 适合需要高精度、低视觉负担的外科手术等场景
我们研究了振动触觉腕部反馈如何提升光学透明增强现实(AR)中手持工具运动的空间引导效果。尽管AR叠加广泛用于手术任务,但视觉遮挡、光照条件及界面模糊可能影响精度与信心。为此,我们设计了一个融合AR视觉与定制腕戴触觉装置的多模态系统,提供方向性与状态性提示。通过与经验丰富的外科医生和住院医师的形成性研究,确定了关键工具操作及参考映射偏好,指导提示设计。在21名参与者中进行的提示识别实验表明,在视觉负荷下参与者能准确识别五种振动模式,全执行器状态提示识别率高于方向提示。在27名参与者参与的引导任务中,同时使用AR与触觉反馈的组别空间精度达到5.8毫米,用户体验量表(SUS)得分为88.1,显著优于单独使用任一模态的组别,尽管任务时间略有增加。参与者报告称触觉提示提供了确认感,降低了对齐时的认知负担。结果表明,将腕部触觉反馈集成至AR系统,对高精度、视觉复杂任务如手术引导具有显著前景。我们讨论了支持自信、高效工具操作的多模态接口的设计启示。
原文摘要 · Abstract (English)
We investigate how vibrotactile wrist feedback can enhance spatial guidance for handheld tool movement in optical see-through augmented reality (AR). While AR overlays are widely used to support surgical tasks, visual occlusion, lighting conditions, and interface ambiguity can compromise precision and confidence. To address these challenges, we designed a multimodal system combining AR visuals with a custom wrist-worn haptic device delivering directional and state-based cues. A formative study with experienced surgeons and residents identified key tool maneuvers and preferences for reference mappings, guiding our cue design. In a cue identification experiment (N=21), participants accurately recognized five vibration patterns under visual load, with higher recognition for full-actuator states than spatial direction cues. In a guidance task (N=27), participants using both AR and haptics achieved significantly higher spatial precision (5.8 mm) and usability (SUS = 88.1) than those using either modality alone, despite having modest increases in task time. Participants reported that haptic cues provided reassuring confirmation and reduced cognitive effort during alignment. Our results highlight the promise of integrating wrist-based haptics into AR systems for high-precision, visually complex tasks such as surgical guidance. We discuss design implications for multimodal interfaces supporting confident, efficient tool manipulation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。