自动优化网页内容以适配生成式搜索引擎
What Generative Search Engines Like and How to Optimize Web Content Cooperatively
- 用大模型分析生成式搜索偏好,提取可操作规则
- 在GEO-Bench等数据集上提升内容曝光率,同时保持搜索效果
- 适合希望提升在AI搜索中可见性的网站运营者
利用大语言模型检索文档并生成自然语言响应,生成式搜索引擎(如Google AI概览、ChatGPT)显著提升了用户体验,并迅速成为主流搜索形式。其快速普及催生了生成式搜索引擎优化(GEO)需求,内容提供方亟需提升在其中的曝光度。本文提出AutoGEO框架,自动学习生成式引擎对检索内容的偏好,并据此重写网页内容以获得更多流量。AutoGEO首先通过前沿大模型解释引擎偏好并提取有意义的规则;随后将这些规则用于上下文工程,构建基于提示的GEO系统AutoGEO$_\text{API}$,并作为规则奖励训练成本更低的AutoGEO$_\text{Mini}$模型。在标准GEO-Bench及两个基于真实用户查询的新基准上的实验表明,AutoGEO能有效提升内容吸引力,同时维持搜索实用性。分析证实所学规则具备鲁棒性,可捕捉不同领域的独特偏好,且AutoGEO系统能成功将其嵌入内容优化中。代码已开源:https://github.com/cxcscmu/AutoGEO。
原文摘要 · Abstract (English)
By employing large language models (LLMs) to retrieve documents and generate natural language responses, Generative Engines, such as Google AI overview and ChatGPT, provide significantly enhanced user experiences and have rapidly become the new form of search. Their rapid adoption also drives the needs of Generative Engine Optimization (GEO), as content providers are eager to gain more traction from them. In this paper, we introduce AutoGEO, a framework to automatically learn generative engine preferences when using retrieved contents for response generation, and rewrite web contents for more such traction. AutoGEO first prompts frontier LLMs to explain generative engine preferences and extract meaningful preference rules from these explanations. Then it uses preference rules as context engineering for AutoGEO$_\text{API}$, a prompt-based GEO system, and as rule-based rewards to train AutoGEO$_\text{Mini}$, a cost-effective GEO model. Experiments on the standard GEO-Bench and two newly constructed benchmarks using real user queries demonstrate the effectiveness of AutoGEO in enhancing content traction while preserving search utility. Analyses confirm the learned rules' robustness and abilities to capture unique preferences in variant domains, and AutoGEO systems' ability to embed them in content optimization. The code is released at https://github.com/cxcscmu/AutoGEO.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。