arXiv:2602.14153cs.CV2026-02

ARport无需标记即可将手术规划精准投射到患者体表,提升机器人手术置管效率。

ARport: An Augmented Reality System for Markerless Image-Guided Port Placement in Robotic Surgery

  • 基于光学头显的无标记三维重建与注册,自动对齐术前规划与真实人体
  • 在人体模型实验中实现虚拟穿刺点与真实体表高度一致的空间对应
  • 适合追求无标记化、快速部署的机器人手术团队使用

目的:精确的穿刺孔位置设定是机器人辅助手术中的关键步骤,其布局直接影响术野可视性与器械操作空间。为弥合术前规划与术中执行之间的差距,本文提出ARport,一种增强现实(AR)系统,可将预设的穿刺器布局自动映射至患者体表,提供直观的空间引导。方法:该系统部署于光学透视式头戴显示器(OST-HMD),无需外部传感器或标记,简化了准备流程并提升了工作流兼容性。它利用OST-HMD采集的RGB、深度和位姿数据重建术区场景,通过基础模型提取患者体表,并采用基于表面的无标记注册,将术前解剖模型与提取的体表对齐,实现计划穿刺点的实时可视化。演示视频已在线发布。结果:在全尺寸人体模型实验中,ARport成功将预设穿刺点准确叠加于物理模型上,实现了虚拟规划与真实解剖的一致空间对应。结论:ARport提供了完全无标记且硬件需求最小的解决方案,可直接在患者体表呈现术前穿刺规划,有助于高效完成术中准备,具备融入常规临床流程的潜力。

原文摘要 · Abstract (English)

Purpose: Precise port placement is a critical step in robot-assisted surgery, where port configuration influences both visual access to the operative field and instrument maneuverability. To bridge the gap between preoperative planning and intraoperative execution, we present ARport, an augmented reality (AR) system that automatically maps pre-planned trocar layouts onto the patient's body surface, providing intuitive spatial guidance during surgical preparation. Methods: ARport, implemented on an optical see-through head-mounted display (OST-HMD), operates without any external sensors or markers, simplifying setup and enhancing workflow integration. It reconstructs the operative scene from RGB, depth, and pose data captured by the OST-HMD, extracts the patient's body surface using a foundation model, and performs surface-based markerless registration to align preoperative anatomical models to the extracted patient's body surface, enabling in-situ visualization of planned trocar layouts. A demonstration video illustrating the overall workflow is available online. Results: In full-scale human-phantom experiments, ARport accurately overlaid pre-planned trocar sites onto the physical phantom, achieving consistent spatial correspondence between virtual plans and real anatomy. Conclusion: ARport provides a fully marker-free and hardware-minimal solution for visualizing preoperative trocar plans directly on the patient's body surface. The system facilitates efficient intraoperative setup and demonstrates potential for seamless integration into routine clinical workflows.

增强现实手术导航机器人手术

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。