arXiv:2606.00564cs.CVcs.CL2026-06被引 6

拆解视觉语言模型蒸馏损失,让小模型更精准对齐视觉信息。

Decomposed On-Policy Distillation for Vision-Language Reasoning: Steering Gradients for Visual Grounding

论文配图:Decomposed On-Policy Distillation for Vision-Language Reasoning: Steering Gradients for Visual Grounding
图 1 · 摘自论文原文
  • 将蒸馏损失分解为语言先验与视觉定位两部分
  • 新方法使小模型在多个基准上视觉定位性能显著提升
  • 适合需要高效推理的轻量级视觉语言模型开发者

尽管在线策略蒸馏能为小型推理模型提供密集监督,但其在多模态领域的优化动态仍不明确。本文通过数学分解,将视觉语言模型(VLM)蒸馏损失分为语言先验和视觉定位两个独立分量。分析发现,这两部分的梯度向量近乎正交,说明语言分布对齐与视觉感知匹配在几何上相互独立。标准优化过程被动遵循次优的折中轨迹,隐含地平衡二者。假设视觉定位是视觉语言推理的主要瓶颈,我们提出视觉梯度引导(VGS),动态重定向更新方向以优先关注视觉子空间。在多种蒸馏设置和复杂多模态基准上的实验表明,VGS显著优于传统的单一蒸馏范式,在几乎无额外训练开销下实现了更优的视觉定位性能。

原文摘要 · Abstract (English)

While on-policy distillation offers dense supervision for training small reasoning models, its optimization dynamics in the multimodal domain remain under-explored. In this work, we challenge the standard monolithic view of Vision-Language Model (VLM) distillation by mathematically decomposing the loss into two distinct components: the language prior and visual grounding. Our analysis uncovers that gradient vectors for these components are nearly orthogonal, indicating that the objective of aligning with the teacher's language distribution is geometrically independent from the objective of matching its visual perception. Consequently, standard optimization passively follows a suboptimal compromise trajectory that implicitly balances the two objectives. Hypothesizing that visual grounding constitutes the primary bottleneck for vision-language reasoning, we introduce Visual Gradient Steering (VGS), a method that dynamically reorients the update vector to prioritize the visual subspace. Experimental results on multiple distillation settings and complex multimodal benchmarks demonstrate that VGS significantly outperforms the standard monolithic formulation of on-policy distillation, achieving superior grounding with minimal training overhead.

视觉定位模型蒸馏多模态

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。