AdaSpot动态选择关键帧区域,高效实现视频事件精准定位。
AdaSpot: Spend Resolution Where It Matters for Precise Event Spotting
- 按任务需求自适应选择关键区域进行高分辨率处理
- 在Tennis和FineDiving上分别提升3.96和2.26 mAP@0
- 适合需要高精度定位的体育分析与机器人应用
精确事件定位旨在以高时间精度定位视频中的快速动作或事件,是体育分析、机器人及自动驾驶系统的关键任务。现有方法通常均匀处理所有帧,忽略了视频数据固有的时空冗余,导致在非信息区域产生冗余计算,同时为保持效率常进行空间下采样,损失精确定位所需的细粒度细节。为此,我们提出AdaSpot:通过低分辨率视频提取全局任务相关特征,并自适应选择每帧中最信息丰富的感兴趣区域进行高分辨率处理。该选择采用无监督、任务感知策略,保持帧间时空一致性,避免可学习方案的训练不稳定性。该设计在仅增加少量计算开销的情况下,保留了关键细粒度视觉线索,远优于均匀高分辨率处理。在标准PES基准测试中,AdaSpot在严格评估指标下取得当前最优性能(如Tennis和FineDiving上分别提升+3.96和+2.26 mAP@0帧),同时在宽松指标下也表现优异。代码已公开于https://github.com/arturxe2/AdaSpot。
原文摘要 · Abstract (English)
Precise Event Spotting aims to localize fast-paced actions or events in videos with high temporal precision, a key task for applications in sports analytics, robotics, and autonomous systems. Existing methods typically process all frames uniformly, overlooking the inherent spatio-temporal redundancy in video data. This leads to redundant computation on non-informative regions while limiting overall efficiency. To remain tractable, they often spatially downsample inputs, losing fine-grained details crucial for precise localization. To address these limitations, we propose \textbf{AdaSpot}, a simple yet effective framework that processes low-resolution videos to extract global task-relevant features while adaptively selecting the most informative region-of-interest in each frame for high-resolution processing. The selection is performed via an unsupervised, task-aware strategy that maintains spatio-temporal consistency across frames and avoids the training instability of learnable alternatives. This design preserves essential fine-grained visual cues with a marginal computational overhead compared to low-resolution-only baselines, while remaining far more efficient than uniform high-resolution processing. Experiments on standard PES benchmarks demonstrate that \textbf{AdaSpot} achieves state-of-the-art performance under strict evaluation metrics (\eg, $+3.96$ and $+2.26$ mAP$@0$ frames on Tennis and FineDiving), while also maintaining strong results under looser metrics. Code is available at: \href{https://github.com/arturxe2/AdaSpot}{https://github.com/arturxe2/AdaSpot}.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。