arXiv:2603.07909cs.ROcs.AI2026-03

纯视觉导航实现支气管镜机器人自主操作,无需外部定位设备。

Long-Short Term Agents for Pure-Vision Bronchoscopy Robotic Autonomy

  • 分层长短时代理:短期反应控制+长期策略决策
  • 在活体猪模型中达到专家级导航成功率
  • 仅用术前CT与实时视频,实现无传感器自主导航

精准的术中导航对机器人辅助内腔介入至关重要,但受限于内窥镜视野狭窄和动态伪影。现有平台多依赖电磁追踪或形状感知等外部定位技术,增加硬件复杂性且易受解剖不匹配影响。本文提出一种纯视觉自主框架,利用术前CT生成的虚拟目标与实时内窥视频,在导航过程中无需外部追踪。系统采用分层长短时代理:短期反应代理实现低延迟连续运动控制,长期战略代理在解剖模糊点提供决策支持。当二者建议冲突时,世界模型评判器预测候选动作的未来视觉状态,并选择最匹配目标视图的动作。在高保真气道模型、三具离体猪肺及活体猪模型上评估,系统在模型中成功抵达所有预定段支气管目标,离体实验中第八代分支保持80%成功率,活体表现接近专家支气管镜医师水平。结果验证了无传感器自主支气管镜导航的临床前可行性。

原文摘要 · Abstract (English)

Accurate intraoperative navigation is essential for robot-assisted endoluminal intervention, but remains difficult because of limited endoscopic field of view and dynamic artifacts. Existing navigation platforms often rely on external localization technologies, such as electromagnetic tracking or shape sensing, which increase hardware complexity and remain vulnerable to intraoperative anatomical mismatch. We present a vision-only autonomy framework that performs long-horizon bronchoscopic navigation using preoperative CT-derived virtual targets and live endoscopic video, without external tracking during navigation. The framework uses hierarchical long-short agents: a short-term reactive agent for continuous low-latency motion control, and a long-term strategic agent for decision support at anatomically ambiguous points. When their recommendations conflict, a world-model critic predicts future visual states for candidate actions and selects the action whose predicted state best matches the target view. We evaluated the system in a high-fidelity airway phantom, three ex vivo porcine lungs, and a live porcine model. The system reached all planned segmental targets in the phantom, maintained 80\% success to the eighth generation ex vivo, and achieved in vivo navigation performance comparable to the expert bronchoscopist. These results support the preclinical feasibility of sensor-free autonomous bronchoscopic navigation.

支气管镜机器人导航纯视觉自主系统

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。