用分层策略高效准确链接海量商品,图像和搜索让难例不再难。
Retrieve, Match, Escalate: Accurate and Scalable Product Linking with VLM-Distilled Cross-Encoders and Agentic VLMs
- 先检索候选,再用轻量模型自动匹配高置信度项,最后用智能视觉模型处理模糊项。
- 98%精确率下自动接受链接,仅需少量人工审核;最终覆盖率达77%。
- 无需微调的自托管模型,成本仅为闭源模型的七分之一,适合大规模部署。
商品链接是将商户商品记录映射到标准产品目录的实体识别任务,旨在合并分散的条目,使下游搜索、推荐和广告系统能统一管理。在电商规模下,数十亿噪声多类别记录需与数百万标准产品匹配,单一模型全量评分既难以应对复杂案例,又对简单案例成本过高。本文提出一种生产级“检索-匹配-升级”级联框架:检索阶段筛选可能匹配项,轻量文本交叉编码器自动解决高置信度多数情况,而智能多模态视觉语言模型通过分析商品图像并发起网页搜索,解决剩余模糊项。交叉编码器基于数百万双视觉语言模型共识标签蒸馏训练,无需人工标注,经验证在98%精确率下可自动接受链接。智能体为自托管开源权重模型,在召回率低4个百分点(88%对比92%)的情况下,每对链接成本仅为闭源前沿模型的约七分之一,且无需微调。单对成本跨度近五个数量级,仅将困难尾部升级至智能体,即可将整体链接覆盖率从廉价阶段的68%提升至77%。
原文摘要 · Abstract (English)
Product linking, the entity-resolution task of mapping merchant product records to canonical catalog products, consolidates fragmented listings so downstream search, recommendation, and advertising see one clean entry per product. At marketplace scale, billions of noisy, multi-category records must be resolved against tens of millions of canonical products, where scoring every candidate with a single model is either too weak for the hard cases or too costly for the easy ones. We present a production retrieve-then-match cascade that spends computation in proportion to difficulty: retrieval surfaces plausible matches, a lightweight text cross-encoder auto-resolves the high-confidence majority, and an agentic multimodal vision-language model settles the ambiguous remainder by inspecting product images and issuing web searches for evidence that is in neither record. The cross-encoder is distilled from millions of dual-VLM-consensus labels, retiring human annotation from the training set, and is calibrated to auto-accept links at a 98% precision bar validated against a smaller operator-certified audit. The agent is a self-hosted open-weight model that reaches a closed frontier VLM's precision at a four-point recall cost (88% versus 92%) for roughly one-seventh the per-pair cost, with no fine-tuning. Per-pair cost spans nearly five orders of magnitude from the cheap cross-encoder to the frontier VLM, so escalating only the hard tail to the agent raises end-to-end link coverage from the cheap stage's 68% to 77%.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。