arXiv:2605.06094cs.CVcs.AI2026-05被引 9

通过结构化自蒸馏提升视频推理能力,让模型学得更准更快。

VISD: Enhancing Video Reasoning via Structured Self-Distillation

论文配图:VISD: Enhancing Video Reasoning via Structured Self-Distillation
图 1 · 摘自论文原文
  • 用多维度评估器分解推理质量,提供细粒度监督信号。
  • 相比基线,准确率与时空定位能力显著提升,收敛速度接近翻倍。
  • 适合需要精准视频理解的复杂推理任务,如长视频问答。

训练视频大模型进行复杂推理仍具挑战,源于序列级奖励稀疏及长时间程推理轨迹中难以进行细粒度贡献归因。尽管带可验证奖励的强化学习(RLVR)提供可靠监督,却无法捕捉词元级贡献,导致学习效率低。现有自蒸馏方法虽提供密集监督,但缺乏结构与诊断特异性,且常与强化学习产生不稳定性交互。本文提出VISD,一种结构化自蒸馏框架,引入诊断性有意义的特权信息用于视频推理。VISD采用视频感知判别模型,将推理质量分解为答案正确性、逻辑一致性与时空定位等多个维度,并以此结构化反馈指导教师策略进行词元级监督。为稳定融合密集监督与强化学习,提出方向-幅度解耦机制:从奖励计算的回溯级优势决定更新方向,而结构化特权信号调节词元级更新幅度。该设计实现语义对齐的细粒度归因,提升推理忠实性与训练效率。此外,VISD引入课程调度与基于EMA的教师稳定化策略,支持长视频序列上的稳健优化。在多个基准测试上,VISD持续优于强基线,显著提升答案准确率与时空定位质量。值得注意的是,其优化步骤收敛速度接近翻倍,表明结构化自监督在提升视频大模型性能与样本效率方面的有效性。

原文摘要 · Abstract (English)

Training VideoLLMs for complex reasoning remains challenging due to sparse sequence level rewards and the lack of fine grained credit assignment over long, temporally grounded reasoning trajectories. While reinforcement learning with verifiable rewards (RLVR) provides reliable supervision, it fails to capture token level contributions, leading to inefficient learning. Conversely, existing self distillation methods offer dense supervision but lack structure and diagnostic specificity, and often interact unstably with reinforcement learning. In this work, we propose VISD, a structured self distillation framework that introduces diagnostically meaningful privileged information for video reasoning. VISD employs a video aware judge model to decompose reasoning quality into multiple dimensions, including answer correctness, logical consistency, and spatio-temporal grounding, and uses this structured feedback to guide a teacher policy for token level supervision. To stably integrate dense supervision with RL, we introduce a direction magnitude decoupling mechanism, where rollout level advantages computed from rewards determine update direction, while structured privileged signals modulate token level update magnitudes. This design enables semantically aligned and fine grained credit assignment, improving both reasoning faithfulness and training efficiency. Additionally, VISD incorporates curriculum scheduling and EMA based teacher stabilization to support robust optimization over long video sequences. Experiments on diverse benchmarks show that VISD consistently outperforms strong baselines, improving answer accuracy and spatio temporal grounding quality. Notably, VISD reaches these gains with nearly 2x faster convergence in optimization steps, highlighting the effectiveness of structured self supervision in improving both performance and sample efficiency for VideoLLMs.

视频推理自蒸馏强化学习大模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。