构建首个电商生成引擎优化数据集,实证提升搜索相关性。
E-GEO: A Testbed for Generative Engine Optimization in E-Commerce
- 设计E-GEO数据集,包含1.37万条真实购物查询与商品列表。
- 提出轻量级提示元优化算法,显著优于传统规则方法。
- 发现通用有效策略,支持生成式搜索可被系统优化。
随着大语言模型的发展,生成式引擎正取代传统搜索,重塑信息检索任务。在电商领域,对话式购物助手已能引导消费者找到相关商品。这一转变催生了生成引擎优化(GEO)的需求——提升生成式引擎的内容可见性与相关性。然而当前GEO实践仍多为经验性操作,其效果在电商场景中尚不明确。为此,我们提出了E-GEO,首个专为电商GEO设计的数据集,包含13,747条真实、多句式消费者商品查询,每条查询对应10个亚马逊商品列表,捕捉了丰富的意图、约束、偏好与购物上下文,弥补现有数据集的不足。基于该数据集,我们首次在五种代表性生成引擎、七种主流LLM重写器与十五种人工编写重写启发式上开展大规模实证研究。我们将GEO建模为优化问题,提出一种轻量级提示元优化算法,显著超越启发式基线。值得注意的是,优化后的提示展现出稳定且跨领域的通用模式,暗示存在“普遍有效”的GEO策略。最后,通过启发式与优化攻击进行红队测试,结果显示,在简单提示内防御下,GEO收益反映真实内容提升而非操纵,确立GEO为实质性、可定义的优化问题。
原文摘要 · Abstract (English)
With the rise of large language models (LLMs), generative engines have become powerful alternatives to traditional search, reshaping retrieval tasks. In e-commerce, for instance, conversational shopping agents now guide consumers to relevant products. This shift has created the need for generative engine optimization (GEO) -- improving content visibility and relevance for generative engines. Despite its growing importance, current GEO practices are largely ad hoc, and their impacts remain poorly understood, especially in the e-commerce setting. We address this gap by introducing E-GEO, the first dataset built specifically for e-commerce GEO. E-GEO contains 13,747 realistic, multi-sentence consumer product queries, each paired with 10 retrieved Amazon listings, capturing rich intent, constraints, preferences, and shopping contexts that existing datasets miss. Using this dataset, we conduct the first large-scale empirical study of e-commerce GEO across five representative generative engines, seven popular LLM rewriters, and fifteen hand-crafted rewriting heuristics. We further formulate GEO as an optimization problem and develop a lightweight prompt meta-optimization algorithm that significantly improves over heuristic baselines. Notably, the optimized prompts reveal a stable, domain-agnostic pattern, suggesting the existence of a "universally effective" GEO strategy. Finally, we red-team the GEO system through both heuristic and optimization-based attacks and show that, under a simple in-prompt defense, gains from GEO reflect genuine content improvement rather than manipulation, anchoring GEO as a substantive and well-defined optimization problem.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。