用少量标注数据快速适配小模型,让视觉模型学会正确推理缺陷判断。
Answer-Conditioned Chain-of-Thought Distillation for Few-Shot Industrial Vision with Small VLMs

- 基于正确答案引导推理过程,确保小模型学习到有效解释路径。
- 仅用18-30张标注图,平均提升1.7至4.4个百分点性能。
- 适合工业缺陷检测中数据稀缺场景,尤其对小模型高效迁移有帮助。
制造业中部署AI视觉检测困难,因需求频繁变更、新缺陷类型不断出现,且大体量标注数据罕见。本文提出答案条件化链式思维(CoT)蒸馏方法,利用极少量标注数据快速适配小型视觉语言模型(VLM)应对新工业任务。前沿VLM接收每张训练图像及其正确标签,生成带理由的视觉解释;随后使用LoRA微调一个30亿参数模型,基于这些带推理的样本进行训练。通过以正确答案为条件,确保所有训练推理均指向正确结论,这对前沿模型在最难点上仅24.1%准确率的情况至关重要。在涵盖三种图像模态的四个工业分类任务上验证,每任务仅需18至30张标注图像。在每个任务4个种子(共32次训练)中,该方法在全部16组种子-任务组合上优于直接微调,平均提升1.7至4.4个百分点。控制变量实验表明,性能提升源于推理质量,而非额外训练步数。无条件基线显示,缺乏答案约束时错误推理导致性能下降17.8个百分点。在焊缝射线图像分类任务中,经微调的30亿参数模型在仅24张训练图像下,表现超越GPT-4.1达10.0个百分点。
原文摘要 · Abstract (English)
Deploying AI-based visual inspection in manufacturing is hard because requirements change often, new defect types appear, and large labeled datasets are rarely available. We propose answer-conditioned chain-of-thought (CoT) distillation for rapidly adapting small vision-language models (VLMs) to new industrial tasks using minimal labeled data. A frontier VLM receives each training image along with its correct label and generates a justified visual explanation. A 3B-parameter model is then fine-tuned on these reasoning-augmented examples via LoRA. By conditioning on correct answers, we ensure all training reasoning is directed toward the correct conclusion, which is critical because frontier models score as low as 24.1% on our hardest task. We validate on four industrial classification tasks spanning three image modalities using only 18 to 30 labeled images per task. Across 4 seeds per task (32 training runs), our method outperforms direct fine-tuning on all 16 seed-task combinations, with mean improvements of +1.7 to +4.4 percentage points. A controlled equal-budget experiment confirms the improvement comes from reasoning quality, not additional training steps. An unconditioned baseline demonstrates that with out answer-conditioning, wrong reasoning degrades performance by 17.8 percentage points. On weld radiograph classification, the fine-tuned 3B model outperforms GPT-4.1 by 10.0pp using just 24 training images.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。