arXiv:2609.02401cs.CV2026-09

通过自信度动态修正学生预测,提升视觉生成模型的稳定性与准确率。

CA-OPD: Confidence-Aware On-Policy Distillation for Structured Visual Prediction

论文配图:CA-OPD: Confidence-Aware On-Policy Distillation for Structured Visual Prediction
图 1 · 摘自论文原文
  • 根据教师置信度选择性修正学生生成的低质量中间结果。
  • 在六个基准上显著超越基线,最高提升9.50分(ScreenSpot-Pro)。
  • 适合需要高精度结构化视觉生成的研究者或开发者。

自回归视觉语言模型虽能统一多种感知任务,但易受误差累积影响。传统在线策略蒸馏(OPD)虽能缓解训练-推理差异,但早期不可靠的学生预测会破坏生成轨迹,降低教师监督质量。现有交错蒸馏方法依赖固定排名机制,忽视教师置信度及干预决策对粒度监督的影响。为此,本文提出自信度感知的在线策略蒸馏(CA-OPD),将可靠的轨迹构建与自适应监督相结合:利用教师置信度选择性修正不可靠的生成步骤,并通过严格到宽松的渐进调度逐步移交生成控制权。关键在于,被修正位置直接接受教师预测的交叉熵监督,保留位置则获得教师完整预测分布。在多教师环境下评估GUI定位与光学字符识别任务,CA-OPD在所有六个目标基准上均显著优于Qwen3.5-0.8B基线,其中ScreenSpot-Pro提升9.50分,OCRBench-v2英文版提升6.72分。控制实验表明,性能提升依赖于干预位置、渐进控制与干预对齐监督,而非干预频率本身。

原文摘要 · Abstract (English)

Autoregressive vision language models unify heterogeneous perception tasks but are highly susceptible to compounding errors. On-policy distillation (OPD) bridges the training-inference mismatch by training students on their own rollouts. However, unreliable student predictions, especially early in training, can derail the trajectory and degrade the quality of teacher supervision. While recent interleaved distillation methods allow the teacher to verify and replace student tokens, they primarily rely on rigid ranking metrics rather than exact teacher confidence, and they overlook how intervention decisions can inform token-level supervision. To address this, we introduce Confidence-Aware On-Policy Distillation (CA-OPD), a framework that couples reliable rollout construction with adaptive supervision. CA-OPD utilizes teacher confidence to selectively correct unreliable student transitions, gradually transferring rollout control to the student via a strict-to-relaxed schedule. Crucially, CA-OPD aligns knowledge transfer with these intervention decisions: corrected positions receive direct cross-entropy supervision from the teacher's prediction, while retained positions benefit from the teacher's full predictive distribution. Evaluated in a multi-teacher setting for GUI grounding and optical character recognition, CA-OPD substantially improves the Qwen3.5-0.8B baseline across all six target benchmarks, including gains of $9.50$ points on ScreenSpot-Pro and $6.72$ points on OCRBench-v2 English. Controlled studies further show that the gains depend on intervention placement, progressive rollout control, and intervention-aligned supervision, rather than intervention frequency alone.

视觉生成知识蒸馏自回归模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。