通过双重信号识别可纠正的感知错误,提升多模态推理模型的蒸馏效果。
Correcting What You Cannot See: Credit Assignment for Perception Distillation in Multimodal Reasoners

- 利用下游失败与师生不一致作为互补证据,动态判断感知错误是否可修正。
- 在8个基准上将8B/2B模型平均准确率从44.50提升至47.28,32B/8B从56.94升至61.22。
- 无需标签,可适配不同规模模型,适合追求多模态推理精度的开发者。
在线策略蒸馏为多模态推理器提供密集监督,但其轨迹级奖励无法判断错误是源于感知还是后续推理。基于共享同一感知的多次推理估算的感知成功率(PSR)因感知不足与推理难度混杂而模糊不清。本文提出无标签的感知修正蒸馏(PCD),利用下游失败与师生不一致作为互补证据,其乘积构成软逻辑与门,仅当两者同时存在时增强蒸馏。该机制基于贝叶斯证据融合,证明乘法是唯一归一化双线性门,任一缺失即消失。PCD采用分离的感知-推理回放与均值保持权重,不影响推理目标。在8个基准测试中,PCD使8B/2B模型宏平均得分从44.50提升至47.28,32B/8B从56.94升至61.22。匹配2B消融实验显示,移除PCD和分离回放分别导致保留平均分下降2.22和0.88点。因此,有效的多模态蒸馏不仅取决于教师预测内容,更在于识别感知是否应成为修正目标。
原文摘要 · Abstract (English)
On-policy distillation provides dense supervision for multimodal reasoners, but its trajectory-level reward cannot determine whether a failed answer arose from perception or subsequent reasoning. Perception Success Rate (PSR), estimated from multiple reasonings sharing one perception, remains ambiguous because low success conflates perceptual insufficiency with reasoning difficulty. We introduce \textbf{Perception-Correction Distillation (PCD)}, a label-free method that identifies correctable perception failures using downstream failure and teacher--student disagreement as complementary witnesses. Their product, , forms a soft AND gate that strengthens distillation only when both witnesses are present. We motivate this rule through Bayesian evidence combination and show that multiplication is the unique normalized bilinear gate that vanishes when either witness is absent. PCD uses separated perception--reasoning rollouts and mean-preserving weights, leaving the reasoning objective unchanged. Across eight benchmarks, PCD improves the 8B 2B macro average from 44.50 with OPD to 47.28 and the 32B 8B result from 56.94 to 61.22. In matched 2B ablations, removing PCD and separated rollout reduces held-out average by 2.22 and 0.88 points, respectively. Effective multimodal distillation therefore depends not only on what the teacher predicts, but also on identifying when perception is the appropriate target of correction.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。