arXiv:2504.09904cs.CV2025-04被引 7

轻量级组织追踪方法,实时手术导航中速度提升7倍

LiteTracker: Leveraging Temporal Causality for Accurate Low-latency Tissue Tracking

  • 利用时间记忆缓冲与先验运动信息实现帧间高效特征复用
  • 推理速度比前代快7倍,比当前最优方法快2倍
  • 兼顾高精度追踪与遮挡预测,适合手术室实时应用

组织追踪在各类手术导航与扩展现实(XR)应用中至关重要。现有基于大规模合成数据训练的方法虽具备高精度和良好泛化能力,但运行效率无法满足实时手术应用的低延迟需求。为此,我们提出 LiteTracker,一种用于内窥镜视频流的低延迟组织追踪方法。LiteTracker 基于先进的长时点追踪框架,引入一系列无需训练的运行时优化:通过时间记忆缓冲实现特征高效复用,并利用先验运动进行精准轨迹初始化,从而支持在线、逐帧追踪。实验表明,LiteTracker 推理速度相比其前代提升约 7 倍,比当前最优方法快 2 倍。除效率外,该方法在 STIR 与 SuPer 两个数据集上均展现出高精度追踪与遮挡预测能力,表现具有竞争力。我们认为 LiteTracker 是实现实时手术环境中低延迟组织追踪的重要一步。代码已公开于 https://github.com/ImFusionGmbH/lite-tracker。

原文摘要 · Abstract (English)

Tissue tracking plays a critical role in various surgical navigation and extended reality (XR) applications. While current methods trained on large synthetic datasets achieve high tracking accuracy and generalize well to endoscopic scenes, their runtime performances fail to meet the low-latency requirements necessary for real-time surgical applications. To address this limitation, we propose LiteTracker, a low-latency method for tissue tracking in endoscopic video streams. LiteTracker builds on a state-of-the-art long-term point tracking method, and introduces a set of training-free runtime optimizations. These optimizations enable online, frame-by-frame tracking by leveraging a temporal memory buffer for efficient feature reuse and utilizing prior motion for accurate track initialization. LiteTracker demonstrates significant runtime improvements being around 7x faster than its predecessor and 2x than the state-of-the-art. Beyond its primary focus on efficiency, LiteTracker delivers high-accuracy tracking and occlusion prediction, performing competitively on both the STIR and SuPer datasets. We believe LiteTracker is an important step toward low-latency tissue tracking for real-time surgical applications in the operating room. Our code is publicly available at https://github.com/ImFusionGmbH/lite-tracker.

组织追踪低延迟手术导航内窥镜

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。