用大模型推理蒸馏出小模型,快速适应电商实体匹配新规则。
MERGED: Multimodal Entity Resolution via Generated Expert Reasoning Distillation

- 用多大模型生成带理由的标签,通过对比学习训练小模型。
- 在多语言电商数据上比人工标注训练模型提升13.79%准确率。
- 只需1万样本即可适配新规则,部署成本仅为大模型的六分之一。
在产品实体消歧任务中,关系定义随业务需求不断变化,传统方法依赖耗时且易错的人工标注,缺乏推理过程。大型视觉语言模型(VLMs)虽能零样本快速响应并提供推理,但其计算成本和延迟难以支撑生产级应用。本文提出MERGED框架,将大模型的标签与结构化推理知识蒸馏至仅70亿参数的小模型中,无需任何人工标注。多个教师模型对每对产品进行标注并说明推理依据:一致结果用于监督微调,分歧由元裁判模型转化为偏好对,用于直接偏好优化。在多语言电商平台数据集上评估,该学生模型相比同构架人工标注训练的模型,PR-AUC提升13.79%,优于更大的Qwen2.5-32B-VL基线6.32%,且成本仅为后者的1/6,同时标签与推理一致性高出10%以上。此外,从已有检查点重新应用MERGED,仅需1万样本即可适应新关系定义,相较零样本提升6.97%性能,超越从头训练。MERGED使新规则的部署周期从数月缩短至数天,满足大规模工业部署需求。
原文摘要 · Abstract (English)
In product entity resolution, relationship definitions constantly evolve with business needs, yet adapting to each change traditionally requires slow, costly human annotation that is often noisy and carries no reasoning. Large vision-language models (VLMs) prompted zero-shot can adapt to a new definition immediately and supply the reasoning that human labels lack, but their cost and latency are prohibitive at production scale. We present MERGED, a distillation framework that transfers not just labels but structured reasoning from large teacher VLMs into a compact 7B-parameter student, requiring no human annotation. Multiple teachers label each product pair and articulate the reasoning behind their decision: agreement pairs supply supervised fine-tuning, while disagreements are resolved by a meta-judge into preference pairs for Direct Preference Optimization. Evaluated against human-labeled ground truth on a multilingual e-commerce dataset, the resulting student improves PR-AUC by 13.79% over the same backbone trained on human labels and surpasses the larger Qwen2.5-32B-VL baseline by 6.32% at 6x lower cost, while also yielding tighter label-reasoning alignment (over 10% above Qwen2.5-32B-VL). Moreover, re-applying MERGED from an existing checkpoint adapts to a new relationship definition with only 10K samples, improving PR-AUC by 6.97% over zero-shot and outperforming from-scratch training. MERGED enables rapid adaptation to evolving relationship definitions, supporting a new one in days rather than months, at a cost and latency suitable for large-scale industrial deployment.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。