用监督代理自动修复电商商品属性缺失,提升生成模型准确率。
CatalogAgent: A Supervisor-mediated Self-Learning System Enabling Context Engineering for GenAI Models

- 引入监督代理调解生成与评估模型冲突,实现自我优化。
- 通过上下文工程注入学习成果,使生成与评估模型性能分别提升15.24%和13.98%。
- 适合需要高精度商品数据的电商平台及大模型应用开发者。
产品目录是电商平台的核心,但大量结构化属性(如材质、颜色、形状)常存在缺失。这些属性通常从商品标题和描述中提取。尽管基于大模型的生成-评估框架在属性预测中表现良好——一个大模型生成属性值,另一个评估其合理性——但当生成器与评估器输出矛盾时,二者均可能出错。本文提出《CatalogAgent》,一种由监督代理介入的自学习系统,持续优化生成与评估模型。当出现内部冲突或卖家对大模型输出提供外部反馈时,监督代理会介入决策。系统还包含记忆库与记忆摘要器,存储并聚合监督代理的决策模式,反哺生成与评估大模型,实现无需人工干预的自我提升。通过上下文工程将监督代理的知识注入工作模型,使生成与评估模型性能分别提升15.24%和13.98%。实验验证了该监督代理驱动的自学习范式在提升生成式AI准确性方面的有效性。
原文摘要 · Abstract (English)
Product catalogs are the backbone of e-commerce sites, yet a large number of structured attributes (SAs) -- such as material, color, and shape -- often have missing values. Typically, SA values are extracted from product information, including titles and descriptions. While LLM-based generator-evaluator frameworks have demonstrated effectiveness for SA prediction -- where an LLM generates SA values and another evaluates them -- they face challenges when the Generator and Evaluator produce conflicting outputs, as either component can make mistakes. We introduce \texttt{CatalogAgent}, a novel agentic system that continuously improves Generator and Evaluator models for e-commerce catalog enrichment. When disagreements arise from (1) internal conflicts between the LLM-based Generator and Evaluator, or (2) external feedback from sellers on LLM outputs, a Supervisor Agent intervenes to mediate these conflicts and make final decisions. The system also incorporates a Memory Base and a Memory Summarizer that stores Supervisor Agent activities from individual cases and aggregates patterns into learnings. These learnings are fed back to the worker Generator and Evaluator LLMs, enabling self-improvement without human intervention. Through context engineering -- injecting learnings and insights into worker LLMs' contexts -- the system successfully transfers the Supervisor's capabilities to the Generator and Evaluator, improving their performance by 15.24\% and 13.98\%, respectively. Our experiments demonstrate a new paradigm of Supervisor Agent-mediated self-learning systems for improving generative AI model accuracy.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。