让视觉模型学会像对比参考图一样识别细微异常,无需额外推理。
ADOPD: Reference-Privileged On-Policy Distillation for MLLM-Based Industrial Anomaly Detection

- 用教师模型指导学生模型,在训练中内化参考图对比能力。
- 零样本下在MMAD数据集达77.31%准确率,比基线高6.14点。
- 适合工业缺陷检测场景,尤其对细粒度异常敏感的领域。
工业异常检测(IAD)需识别正常视觉模式中的细微偏差。多模态大语言模型(MLLM)可通过推理时对比查询图与参考图提升识别精度,但依赖额外检索与处理。本文探讨是否可将参考图对比的优势内化至模型参数。训练中引入参考图使参考感知教师监督仅输入查询的学生模型。然而,教师可能偏好基于查询线索或语言先验的合理回答,而非有效视觉信息。为此提出ADOPD:一种参考特权的在线策略蒸馏框架。教师评估学生生成轨迹在匹配与不匹配参考下的表现。匹配参考下的教师到学生对数比定义了逐标记学习方向,明确学生应学内容;两参考视图的似然差距估计参考特异性支持并校准序列级权重。ADOPD在零样本推理下于MMAD基准达77.31%平均准确率,较Qwen3-VL-4B骨干网络提升6.14点,优于其单样本设置2.64点。实验表明,ADOPD从参考对比中学习到细粒度异常检测策略。
原文摘要 · Abstract (English)
Industrial anomaly detection (IAD) requires identifying fine-grained deviations from normal visual patterns. Multimodal large language models (MLLMs) can improve recognition accuracy by comparing query images with references at inference time, but these benefits rely on additional retrieval and processing. We investigate whether the benefits of reference comparison can instead be internalized in the model parameters. Access to references during training allows a reference-aware teacher to supervise a query-only student. However, the teacher may favor plausible responses based on query cues or language priors rather than valid visual information. We propose ADOPD, a reference-privileged on-policy distillation framework. The teacher evaluates student-generated rollouts under matched and mismatched references. The matched-reference teacher-to-student log-ratio defines the token-level learning direction, specifying what the student should learn. The likelihood gap between the two reference views estimates reference-specific support and calibrates the sequence-level weight. ADOPD achieves 77.31% average accuracy on the MMAD benchmark under zero-shot inference, improving the Qwen3-VL-4B backbone by 6.14 points and outperforming its one-shot setting by 2.64 points. Experiments show that ADOPD learns a fine-grained anomaly inspection strategy from reference comparison. The project will be available at https://github.com/withTai/ADOPD.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。