arXiv:2604.20851cs.IRcs.AI2026-04中稿 · ICLR

针对视频文本检索中查询分布偏移导致的性能下降,提出新方法提升鲁棒性。

Robust Test-time Video-Text Retrieval: Benchmarking and Adapting for Query Shifts

论文配图:Robust Test-time Video-Text Retrieval: Benchmarking and Adapting for Query Shifts
图 1 · 摘自论文原文
  • 构建12类视频扰动基准,评估查询偏移下的模型表现
  • 发现查询偏移加剧了
  • 适合关注真实场景下视频检索鲁棒性的研究者

现代视频-文本检索(VTR)模型在分布内基准上表现优异,但对真实世界中的查询分布偏移极为敏感,导致性能急剧下降。现有以图像为中心的鲁棒性方法难以应对视频中的复杂时空动态变化。为此,我们首次引入一个综合性基准,涵盖5种严重程度下的12种不同类型的视频扰动。分析表明,查询偏移会加剧“中心化现象”(hubness),即少数候选项成为吸引大量查询的主导“枢纽”。为缓解此问题,我们提出HAT-VTR(Hubness Alleviation for Test-time Video-Text Retrieval),一种直接对抗VTR中中心化的测试时自适应框架。该方法包含两个关键组件:用于优化相似度得分的中心化抑制记忆模块,以及促进时序特征一致性的多粒度损失函数。大量实验表明,HAT-VTR在多种查询偏移场景下显著提升鲁棒性,持续优于现有方法,增强了模型在真实应用中的可靠性。

原文摘要 · Abstract (English)

Modern video-text retrieval (VTR) models excel on in-distribution benchmarks but are highly vulnerable to real-world query shifts, where the distribution of query data deviates from the training domain, leading to a sharp performance drop. Existing image-focused robustness solutions are inadequate to handle this vulnerability in video, as they fail to address the complex spatio-temporal dynamics inherent in these shifts. To systematically evaluate this vulnerability, we first introduce a comprehensive benchmark featuring 12 distinct types of video perturbations across five severity degrees. Analysis on this benchmark reveals that query shifts amplify the hubness phenomenon, where a few gallery items become dominant "hubs" that attract a disproportionate number of queries. To mitigate this, we then propose HAT-VTR (Hubness Alleviation for Test-time Video-Text Retrieval), as our baseline test-time adaptation framework designed to directly counteract hubness in VTR. It leverages two key components: a Hubness Suppression Memory to refine similarity scores, and multi-granular losses to enforce temporal feature consistency. Extensive experiments demonstrate that HAT-VTR substantially improves robustness, consistently outperforming prior methods across diverse query shift scenarios, and enhancing model reliability for real-world applications.

视频检索测试时自适应鲁棒性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。