用自修正提升电商属性抽取,但成本高且效果不明显。
Self-Refinement Strategies for LLM-based Product Attribute Value Extraction
- 尝试错误重写和自我纠错两种自修正方法
- 两种方法均未显著提升效果,却大幅增加计算开销
- 微调在有数据时最优,适合大规模产品描述场景
结构化产品数据(属性-值对)对电商的分类搜索与属性比较功能至关重要。但商家提供的多为非结构化描述,需进行属性值抽取以保证数据一致性与可用性。大语言模型(LLM)在少样本场景下已展现抽取潜力。近期研究显示,自修正技术可提升代码生成与文本转SQL任务性能。然而,在其他任务中,该技术因增加额外令牌处理而提高成本,且未带来性能提升。本文评估了两种自修正策略(基于错误的提示重写与自我纠错)在产品属性值抽取任务中的表现,覆盖零样本、少样本上下文学习及微调三种场景,使用GPT-4o进行实验。结果表明,两种方法均未能显著提升抽取性能,反而大幅增加处理成本。在有开发数据的场景下,微调表现最佳,其高昂的初始成本随产品描述量增加而逐渐被抵消。
原文摘要 · Abstract (English)
Structured product data, in the form of attribute-value pairs, is essential for e-commerce platforms to support features such as faceted product search and attribute-based product comparison. However, vendors often provide unstructured product descriptions, making attribute value extraction necessary to ensure data consistency and usability. Large language models (LLMs) have demonstrated their potential for product attribute value extraction in few-shot scenarios. Recent research has shown that self-refinement techniques can improve the performance of LLMs on tasks such as code generation and text-to-SQL translation. For other tasks, the application of these techniques has resulted in increased costs due to processing additional tokens, without achieving any improvement in performance. This paper investigates applying two self-refinement techniques (error-based prompt rewriting and self-correction) to the product attribute value extraction task. The self-refinement techniques are evaluated across zero-shot, few-shot in-context learning, and fine-tuning scenarios using GPT-4o. The experiments show that both self-refinement techniques fail to significantly improve the extraction performance while substantially increasing processing costs. For scenarios with development data, fine-tuning yields the highest performance, while the ramp-up costs of fine-tuning are balanced out as the amount of product descriptions increases.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。