用微调Transformer模型提升网页内容在AI搜索中的可见性。
Beyond SEO: A Transformer-Based Approach for Reinventing Web Content Optimisation
- 基于BART-base微调,用合成旅行网站数据对内容进行优化
- 优化后内容在AI搜索中词数增加15.63%,排名相关词数提升30.96%
- 小规模微调即可显著提升内容可见性,适合内容创作者和SEO从业者
生成式AI搜索引擎的兴起正在冲击传统SEO,Gartner预测到2026年传统搜索使用量将下降25%。为此,我们提出一种针对生成式引擎优化(GEO)的领域特定微调方法,通过调整网页内容以提升其在大语言模型输出中的可发现性。该方法在包含1,905对清洗后的旅行网站内容的合成数据上微调BART-base模型,每对包含原始文本与加入可信引用、统计数据及语言流畅性改进的优化版本。评估采用内在指标(ROUGE-L、BLEU)和外在可见性测试,结合控制实验使用Llama-3.3-70B。微调模型相比基线显著提升:ROUGE-L达0.249(基准0.226),BLEU达0.200(基准0.173)。更重要的是,优化内容在生成式搜索中表现出明显可见性提升,绝对词数增加15.63%,位置调整词数提升30.96%。本研究首次实证表明,针对性的Transformer微调可在计算资源有限条件下有效增强网页内容在生成式搜索引擎中的可见性,支持GEO作为面向AI搜索时代的内容优化可行路径。
原文摘要 · Abstract (English)
The rise of generative AI search engines is disrupting traditional SEO, with Gartner predicting 25% reduction in conventional search usage by 2026. This necessitates new approaches for web content visibility in AI-driven search environments. We present a domain-specific fine-tuning approach for Generative Engine Optimization (GEO) that transforms web content to improve discoverability in large language model outputs. Our method fine-tunes a BART-base transformer on synthetically generated training data comprising 1,905 cleaned travel website content pairs. Each pair consists of raw website text and its GEO-optimized counterpart incorporating credible citations, statistical evidence, and improved linguistic fluency. We evaluate using intrinsic metrics (ROUGE-L, BLEU) and extrinsic visibility assessments through controlled experiments with Llama-3.3-70B. The fine-tuned model achieves significant improvements over baseline BART: ROUGE-L scores of 0.249 (vs. 0.226) and BLEU scores of 0.200 (vs. 0.173). Most importantly, optimized content demonstrates substantial visibility gains in generative search responses with 15.63% improvement in absolute word count and 30.96% improvement in position-adjusted word count metrics. This work provides the first empirical demonstration that targeted transformer fine-tuning can effectively enhance web content visibility in generative search engines with modest computational resources. Our results suggest GEO represents a tractable approach for content optimization in the AI-driven search landscape, offering concrete evidence that small-scale, domain-focused fine-tuning yields meaningful improvements in content discoverability.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。