arXiv:2606.03539cs.CV2026-06中稿 · ICME 2026

让模型在低质视频中仍能准确定位,同时不破坏原有知识。

Knowledge-Preserved Model Tuning in Null-Space for Robust Spatio-Temporal Video Grounding

论文配图:Knowledge-Preserved Model Tuning in Null-Space for Robust Spatio-Temporal Video Grounding
图 1 · 摘自论文原文
  • 通过零空间注入可学习残差,只改低质输入而不扰动高质输入。
  • 在混合质量数据集上,性能超越现有最先进方法。
  • 适合需要鲁棒视频定位且保护预训练知识的场景。

时空视频定位旨在根据文本查询定位目标轨迹。尽管近期方法在高质量输入上表现优异,但忽略了真实场景中普遍存在的低质量视频问题。虽有如LoRA等微调方法可适应退化输入,却不可避免地破坏预训练知识。为此,本文提出零空间微调(NST)。该框架利用冻结权重的零空间特性:向层输入添加零空间内的向量不会影响输出。NST通过质量自适应单元与双空间重参数化,合成可学习残差——将高质量输入的成分限制在零空间,而将低质量输入的修复成分导向非零空间。由于冻结权重会消除零空间成分,因此能有效修复退化输入,同时保持高质量输入的预训练知识不变。大量实验表明,NST在我们构建的混合质量基准上优于现有最先进方法。

原文摘要 · Abstract (English)

Spatio-Temporal Video Grounding aims to localize object tubes based on textual queries. While recent methods have achieved remarkable success, they mainly focus on high-quality(HQ) inputs, neglecting the widespread presence of low-quality(LQ) videos in real-world scenarios. Although tuning methods like LoRA can adapt to degraded inputs, they inevitably disrupt pre-trained knowledge. To address this, we propose Null-Space Tuning (NST). This framework exploits the geometric property that adding vectors within the null-space of frozen weights to the layer input does not affect the output. Leveraging this, NST injects learnable residuals into input features that can be selectively invisible to the pre-trained backbone. Specifically, NST combines the Quality-Adaptive Unit and Dual-Space Reparameterization to synthesize these residuals by confining components for HQ inputs to the null-space, while directing restoration components for LQ inputs to the non-null space. As the frozen weights eliminate null-space components, we effectively rectify degraded inputs while preserving pre-trained knowledge for HQ inputs. Extensive experiments show that NST outperforms state-of-the-art methods on our Mixed-Quality benchmark.

视频定位模型微调知识保留鲁棒性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。