arXiv:2409.04073cs.CLcs.AI2024-09被引 14

用小模型实现高效零样本实体匹配,性能接近大模型。

AnyMatch -- Efficient Zero-Shot Entity Matching with a Small Language Model

  • 用迁移学习微调小语言模型,结合自动筛选难例和属性级数据增强。
  • 在9个数据集上F1得分第二,仅比顶级大模型低4.4%。
  • 参数量少四万倍,推理成本降低3899倍,适合实际部署。

实体匹配(EM)旨在判断两条记录是否指向同一现实世界实体,对数据集成(如产品目录或地址库)至关重要。现有方法多依赖标注数据,而零样本实体匹配在无标注数据时更具挑战。尽管大语言模型(LLMs)在零样本EM中表现优异,但其低吞吐量和高部署成本限制了应用。本文提出AnyMatch,一个在迁移学习框架下微调的小语言模型,并设计多种新颖的数据选择策略生成训练数据:通过AutoML筛选难匹配对、生成属性级样本、控制标签不平衡。在9个基准数据集上与13个基线对比评估,结果显示,尽管参数量小,AnyMatch整体F1得分仅次于最佳模型;其平均预测质量仅比使用万亿参数模型GPT-4的MatchGPT低4.4%,但参数量减少四个数量级,每千令牌推理成本降低3899倍。

原文摘要 · Abstract (English)

Entity matching (EM) is the problem of determining whether two records refer to same real-world entity, which is crucial in data integration, e.g., for product catalogs or address databases. A major drawback of many EM approaches is their dependence on labelled examples. We thus focus on the challenging setting of zero-shot entity matching where no labelled examples are available for an unseen target dataset. Recently, large language models (LLMs) have shown promising results for zero-shot EM, but their low throughput and high deployment cost limit their applicability and scalability. We revisit the zero-shot EM problem with AnyMatch, a small language model fine-tuned in a transfer learning setup. We propose several novel data selection techniques to generate fine-tuning data for our model, e.g., by selecting difficult pairs to match via an AutoML filter, by generating additional attribute-level examples, and by controlling label imbalance in the data. We conduct an extensive evaluation of the prediction quality and deployment cost of our model, in a comparison to thirteen baselines on nine benchmark datasets. We find that AnyMatch provides competitive prediction quality despite its small parameter size: it achieves the second-highest F1 score overall, and outperforms several other approaches that employ models with hundreds of billions of parameters. Furthermore, our approach exhibits major cost benefits: the average prediction quality of AnyMatch is within 4.4% of the state-of-the-art method MatchGPT with the proprietary trillion-parameter model GPT-4, yet AnyMatch requires four orders of magnitude less parameters and incurs a 3,899 times lower inference cost (in dollars per 1,000 tokens).

实体匹配小模型零样本效率优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。