arXiv:2607.26780cs.CL2026-07

用两步验证提升大模型提取产品属性的准确率,尤其擅长捕捉稀疏弱表达信息。

Enhancing Generative Information Extraction with Two-step Validation: A Product Attribute Use Case

论文配图:Enhancing Generative Information Extraction with Two-step Validation: A Product Attribute Use Case
图 1 · 摘自论文原文
  • 在生成式信息抽取中加入PLM验证模块,利用大模型纠错能力增强输出。
  • 小模型性能逼近大模型,对低显著性实体提取提升显著,部分达30%以上。
  • 适合隐私敏感场景,支持本地部署,适用于数字产品护照等实际应用。

大型语言模型(LLMs)在文本处理与生成方面的能力为信息抽取(IE)带来了新可能。尽管其在分类任务上是否优于微调的小模型尚存争议,但其强大的泛化能力使其在标注数据稀缺的领域尤为适用。本文以新兴的数字产品护照(DPP)为例,将生成式信息抽取应用于产品领域,同时应对效率、泛化性和数据隐私挑战。提出一种两步验证方法,将预训练语言模型(PLM)模块嵌入生成式抽取流程,利用大模型的纠错能力。实验发现,该验证机制显著提升大模型表现,尤其在稀疏分布、弱表达实体的提取上效果突出。某些实体上,中等规模模型性能可接近大型模型,且第一步PLM预测的改进也提升了最终大模型输出质量。然而,对最小的开源模型(如Llama-3.2 3B)提升有限。基于此,我们构建了一个基于本地部署大模型的产品信息抽取演示系统,为真实世界数字产品护照应用提供可扩展方案。

原文摘要 · Abstract (English)

The ability of large language models (LLMs) to process and generate text has introduced potential for applications in information extraction (IE). While it's debated whether LLMs outperform smaller fine-tuned models for classification tasks, their strong generalization capability makes them promising for domains with limited labeled data available for fine-tuning. This advantage is particularly relevant for the emerging application of the digital product passport (DPP), where the problem space is broad but domain-specific data remains scarce. Motivated by this use case, we apply generative IE to the product domain, explicitly addressing efficiency, generalizability, and data privacy constraints. We propose a two-step validation method that integrates a PLM block into the generative IE pipeline and thereby leverages LLMs' correction capability. We discover that such a validation task enhances LLM performance, particularly on the extraction of weakly expressed, low-salience entities that appear sparsely throughout the text. For certain entities, the performance of mid-size models can even reach levels comparable to larger models, and the improvement of first-step PLM predictions also enhance the final LLM output. Nevertheless, the effects on the smallest open-source LLMs (e.g., Llama-3.2 3B) is limited. Based on the findings, we develop a demo application for product information extraction that utilizes locally deployed LLMs, targeting further adaptations to real-world DPP use cases.

信息抽取大模型产品属性本地部署

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。