arXiv:2606.00775cs.CVcs.AI2026-06

轻量级视频定位模型用强化学习优化边界,解决训练后期精度停滞问题。

GIRL-DETR: Gradient-Isolated Reinforcement Learning for Video Moment Retrieval

论文配图:GIRL-DETR: Gradient-Isolated Reinforcement Learning for Video Moment Retrieval
图 1 · 摘自论文原文
  • 提出梯度隔离的强化学习框架,分离特征表示与定位优化过程。
  • 在三个数据集上显著提升定位准确率,参数更新极少且效果稳定。
  • 适合资源受限场景下的视频片段检索任务,尤其适用于轻量模型部署。

视频片段检索(VMR)需精准定位与自然语言查询对齐的时间边界,但许多模型因连续代理损失与不可微评价指标之间存在偏差,导致训练后期优化停滞,边界预测陷入次优解。尽管强化学习(RL)后处理可有效优化大模型的定位性能,但直接应用于轻量网络易破坏监督训练中建立的脆弱特征表示。为此,本文首次将强化学习引入轻量级时间定位框架,提出GIRL-DETR。视频与文本特征通过跨模态交互(CMI)实现早期对齐,再经由文本引导门控(TGG)机制动态注入语义先验至查询,为时间预测提供高信噪比输入。监督训练收敛后,冻结主干网络以保护特征流形,检测头则通过三阶段渐进式强化学习(TPRL)直接优化非可微指标tIoU,实现状态表示与度量优化的正交解耦。在Charades-STA、QVHighlights和TACoS数据集上的实验表明,GIRL-DETR有效缓解代理损失退化问题,仅用少量参数更新即实现显著精度提升,为轻量级VMR模型中的强化学习应用提供了稳健新路径。

原文摘要 · Abstract (English)

Video Moment Retrieval (VMR) task requires accurately localizing temporal boundaries aligned with natural language queries, but many models suffer from a misalignment between continuous surrogate losses and non-differentiable metrics, leading to optimization stagnation during the late stages of training and trapping boundary predictions in suboptimal solutions. Although Reinforcement Learning (RL) post-training successfully optimizes localization results for large models, applying it directly to lightweight networks easily disrupts the fragile feature representations established during the supervised phase. To overcome this optimization bottleneck, we propose Gradient-Isolated Reinforcement Learning for DETR (GIRL-DETR), introducing RL post-training into a lightweight temporal localization framework for the first time. The input video and text features first establish early alignment through Cross-Modal Interaction (CMI) before entering the transformer encoder. Subsequently, a Text-Guided Gating (TGG) mechanism dynamically injects semantic priors into the queries before the transformer decoder generates candidate proposals, providing high signal-to-noise ratio inputs for temporal prediction. After the supervised training reaches convergence, the backbone network is frozen to protect the feature manifold, while the detection head directly optimizes the non-differentiable evaluation metric tIoU to enhance localization accuracy through a Three-stage Progressive Reinforcement Learning (TPRL) strategy. This approach achieves an orthogonal decoupling of state representation and metric optimization. Experiments on Charades-STA, QVHighlights, and TACoS demonstrate that GIRL-DETR effectively resolves surrogate loss degradation and achieves substantial accuracy improvements with minimal parameter updates, providing a robust new pathway for RL applications in lightweight VMR models.

视频定位强化学习轻量模型时序推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。