研究内容创作者反复迎合大模型排名会如何扭曲内容生态。
CHASE: How Content Ecosystems Are Reshaped When Ranking Is the Only Target

- 构建模拟框架CHASE,追踪内容在排名信号驱动下的演化过程。
- 20轮迭代后,内容质量与排名相关性下降,平均斯皮尔曼系数降0.068。
- 不同领域影响差异大,揭示了优化行为对创作激励的深层重塑。
生成式引擎优化(GEO)正被广泛用于提升大语言模型检索系统中的内容可见性,但其在重复优化下的群体效应仍不明确。我们提出内容同质化于排名信号利用(CHASE)框架,通过模拟创作者持续根据大模型排名信号调整文档的过程,研究内容生态的演变。以排名作为来源可见性的代理,并通过真实生成回答中的引用验证,得到跨六个领域的排名-引用AUC为0.853 ± 0.093。在六种不同领域中,经过20轮的排名、特征区分、重写与评估循环,质量-排名一致性普遍下降:从第0轮到第20轮,斯皮尔曼相关系数变化范围为-0.107至-0.018,均值下降0.068,表明越贴近排名特征的内容,其与独立评价的质量越不一致。随机目标对照组显示,这种变化源于对排名激励的适应,而非单纯重写行为。生态系统动态呈现强领域依赖性。这些结果揭示了固定排名信号下重复优化如何重塑内容群体与创作者激励。
原文摘要 · Abstract (English)
Generative Engine Optimization (GEO) is increasingly used to improve content visibility in LLM-based retrieval systems, yet its population-level effects under repeated optimization remain poorly understood. We introduce Content Homogenization under rAnking Signal Exploitation (CHASE), a controlled simulation framework for studying how content ecosystems are reshaped when creators repeatedly adapt documents to an LLM ranking signal. We use ranking as a proxy for source visibility and validate this abstraction against citations in grounded generated responses, obtaining a rank-citation AUC of 0.853 $\pm$ 0.093 across six domains. CHASE then iterates ranking, feature discrimination, rewriting, and evaluation over 20 rounds across different domains. Quality-ranking alignment decreases in all six domains: from R0 to R20, the change in Spearman's rho ranges from -0.107 to -0.018, with a mean change of -0.068, which means documents closer to the ranking feature profile become less aligned with independently judged document quality over the simulation horizon. A random-target control has shown that it is associated with adaptation toward ranking-derived incentives rather than iterative rewriting alone. The resulting ecosystem dynamics are strongly domain-dependent. Together, these findings show how repeated optimization against a fixed LLM ranking signal can reshape both content populations and the incentives faced by content creators.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。