arXiv:2607.13421cs.CVcs.AI2026-07中稿 · ECCV

提出分阶段视频定位框架,精准定位目标物体的时空轨迹。

ScanFocus: A Coarse-to-Fine Framework for Spatio-Temporal Video Grounding

论文配图:ScanFocus: A Coarse-to-Fine Framework for Spatio-Temporal Video Grounding
图 1 · 摘自论文原文
  • 先全局扫描后局部聚焦,分离粗略定位与精细调优
  • 在三个基准上优于现有方法,显著提升边界定位精度
  • 适合需要高精度视频理解的应用场景,如智能监控

时空视频定位(STVG)旨在根据自然语言描述从视频流中检索特定物体的视觉轨迹。然而,当前先进方法难以兼顾全局上下文建模与精确边界定位。由于长视频处理计算成本高昂,这些方法通常采用低频时间下采样和隐式运动建模,从而抑制了高频边界特征,并忽略了精确边界划分所需的显式帧间依赖关系。为此,我们提出 extbf{ScanFocus},一种新颖的分阶段(粗到精)框架,将 STVG 任务解耦为全局时空扫描与局部边界聚焦两个阶段。具体而言,我们使用统一的视觉-语言融合编码器结合轻量级可变形语义-运动融合模块,高效对齐多模态特征并生成粗略提议。为恢复被抑制的细粒度细节,我们在精修阶段引入语义引导的时间聚合器(SGTA)。通过在粗边界周围密集采样,SGTA 在语义引导下显式建模短时序交互,捕捉快速运动变化,实现精确的时间戳回归。在三个主流基准上的大量实验表明,所提方法显著优于先前方法。代码将发布于 https://github.com/TenMinutes209/ScanFocus。

原文摘要 · Abstract (English)

Spatio-Temporal Video Grounding (STVG) aims to retrieve the visual trajectory of a specific object from a video stream as described by a natural language expression. However, most advanced methods struggle to balance global context modeling with precise boundary localization. Due to the prohibitive computational costs of processing long videos, these approaches typically resort to low-rate temporal downsampling and implicit motion modeling. This inevitably suppresses high-frequency boundary cues and neglects the explicit inter-frame dependencies required for precise boundary delineation. To address these limitations, we present \textbf{ScanFocus}, a novel coarse-to-fine framework that decouples the STVG task into a global spatio-temporal scan and a local boundary focus. Specifically, we utilize a unified vision-language fusion encoder combined with a lightweight Deformable Semantic-Motion Fusion module to efficiently align multimodal features and generate coarse proposals. To recover the suppressed fine-grained details, we introduce the Semantic-Guided Temporal Aggregator (SGTA) in the refinement stage. By densely sampling around coarse boundaries, SGTA explicitly models short-term temporal interactions under semantic guidance, capturing rapid motion changes for precise timestamp regression. Extensive experiments on three widely used benchmarks demonstrate the performance superiority of our proposed method over previous approaches. Code will be released at https://github.com/TenMinutes209/ScanFocus.

视频定位多模态分阶段边界检测

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。