arXiv:2608.07116cs.CVcs.AI2026-08中稿 · ACM MM2026

用解剖结构先验提升支气管镜定位精度与速度

Geometry-Aware Camera Localization for Bronchoscopy

论文配图:Geometry-Aware Camera Localization for Bronchoscopy
图 1 · 摘自论文原文
  • 融合术前解剖结构先验与术中视频,分阶段精化位姿估计
  • 相较最优方法,平移误差降8.37%,旋转误差降31.76%,推理提速4倍至33.6 FPS
  • 适合需要高精度实时导航的内窥镜手术系统开发者

支气管镜中的相机定位因严苛的精度要求、实时性约束及训练数据有限而极具挑战。相比自然场景,受限解剖结构需毫米级精度,术中导航则要求低延迟推理。现有方法未能有效利用术前几何先验,影响鲁棒性与准确性。为此,我们提出统一的几何感知支气管镜定位框架(GABL),融合术前结构先验与术中视频对,实现6-DoF相机位姿估计。针对复杂气道的视觉模糊问题,设计图引导的粗到精定位策略,有效利用结构先验实现精准位姿估计。为缓解位姿抖动并弥合视觉-结构差距,引入基于Transformer的跟踪模型与新型RGB-深度匹配目标,联合强制时空与几何一致性。大量实验表明,本方法相较现有最先进方法,平移误差降低8.37%,旋转误差降低31.76%,推理速度提升4倍(达33.6 FPS),实现稳健的实时定位。项目主页:https://paulili08.github.io/GABL/

原文摘要 · Abstract (English)

Camera localization in bronchoscopy remains a challenging problem due to stringent accuracy requirements, real-time constraints, and limited training data. Compared to natural scenes, the confined anatomical structures demand millimeter-level precision, while intraoperative guidance necessitates low-latency inference. However, existing methods often fail to effectively exploit preoperative geometric priors, limiting their robustness and accuracy. To address these limitations, we propose a unified geometry-aware bronchoscope localization framework (GABL) that effectively fuses preoperative structural priors with paired intraoperative video to estimate 6-DoF camera poses. Specifically, to address visual ambiguity in complex airways, we propose a graph-guided coarse-to-fine localization scheme that effectively leverages structural priors for precise pose estimation. Furthermore, to mitigate pose jitter and bridge the visual-structural gap, we integrate a Transformer-based tracking model with a novel RGB-depth matching objective, jointly enforcing spatio-temporal and geometric consistency. Extensive experiments demonstrate that our method yields remarkable reductions of 8.37% and 31.76% in translation and rotation errors over the prior state-of-the-art, alongside 4 times inference speedup (33.6 FPS) for robust real-time bronchoscope localization. Project website: https://paulili08.github.io/GABL/.

医学影像位姿估计实时定位几何先验

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。