通过追踪手术注意力状态,实现机器人腹腔镜的自主视角控制。
SurgLAT: Surgical Latent Attention Tracking for Depth-Aware Robotic Laparoscope Control

- 用记忆引导的空间先验提取手术证据,建模动态注意力状态。
- 在真实手术视频与机器人平台上验证,可稳定跟踪目标区域。
- 适合需要高精度自主导航的智能手术系统研发者。
自主腹腔镜摄像控制需持续理解术中医生的操作意图,而目标操作区并非静态物理对象,而是随时间演变的潜在注意力状态。本文提出外科潜在注意力追踪(SurgLAT),一种因果在线框架,用于建模潜在手术注意力并实现自主摄像视角控制。SurgLAT采用冻结的DINOv3编码器和状态条件空间令牌混合器,在记忆引导的空间先验下提取手术证据;同时,选择性因果潜在记忆模块通过动态检索当前、近期及历史潜在状态,联合建模短期运动连续性与长期手术意图演化。学习到的潜在手术注意力状态被解码为概率注意力热图与操作区域,用于下游内窥镜引导。此外,我们引入基于虚拟轴公式的机器人部署框架,并结合冗余感知的零空间初始化,实现受远程运动中心(RCM)约束的稳定平滑机械臂运动。我们在真实腹腔镜手术视频和物理机器人腹腔镜平台验证了整个系统。实验结果表明,在遮挡、快速运动和目标切换条件下,系统仍能实现鲁棒的在线操作区域跟踪与稳定的自主内窥镜调节,凸显了潜在手术意图建模对手术自动化的有效性。
原文摘要 · Abstract (English)
Autonomous laparoscopic camera control requires continuous understanding of the surgeon's operative intent in dynamic surgical scenes, where the target operative region is not a stable physical object but a latent and temporally evolving attention state. In this work, we present Surgical Latent Attention Tracking (SurgLAT), a causal online framework for latent surgical attention modeling and autonomous laparoscopic view control. SurgLAT uses a frozen DINOv3 encoder and a state-conditioned spatial token mixer to extract operative evidence under a memory-guided spatial prior, while a selective causal latent memory module jointly models short-term motion continuity and long-horizon surgical intent evolution through dynamic retrieval of current, recent, and historical latent states. The learned latent surgical attention state is decoded into a probabilistic attention heatmap and operative region for downstream endoscope guidance. Beyond perception, we further introduce a robotic deployment framework with explicit laparoscopic Remote Center of Motion (RCM) constrained control based on virtual-axis formulation, together with redundancy-aware null-space initialization for stable and smooth manipulator motion. We validate the full system on real laparoscopic surgical videos and a physical robotic laparoscope platform. Experimental results demonstrate robust online operative-region tracking and stable autonomous endoscopy adjustment under occlusion, rapid motion, and target transitions, highlighting the effectiveness of latent surgical intent modeling for surgical autonomy.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。