arXiv:2605.14021cs.CYcs.AI2026-05被引 2

谷歌AI概要的四大实测发现:生成率高、选源独特、事实错误率超一成、影响出版商收益。

Measuring Google AI Overviews: Activation, Source Quality, Claim Fidelity, and Publisher Impact

论文配图:Measuring Google AI Overviews: Activation, Source Quality, Claim Fidelity, and Publisher Impact
图 1 · 摘自论文原文
  • 通过大规模测试,分析谷歌AI摘要在不同问题类型中的激活率与来源选择机制。
  • 11%的生成内容存在无依据陈述,且来源质量与事实准确性无关。
  • 适合关注信息生态安全、算法透明性及媒体变现困境的研究者与从业者。

谷歌AI概要(AIOs)是目前最广泛使用的生成式AI应用,覆盖超过20亿用户,其回答由AI合成而非传统搜索结果排列。本研究在40天内对19个主题类别的55,393个热门查询进行了纵向测量。结果显示:整体AIO激活率为13.7%,疑问句查询高达64.7%,政治敏感话题显著降低;被引用的域名可信度高于首页结果,近30%未出现在首页结果中,表明独立选源机制;将回复拆解为98,020个原子陈述后发现,11.0%缺乏引文支持,以遗漏为主;超过半数被引用页面含展示广告,用户转向AI摘要导致点击流失,但谷歌自身广告仍保留。这些发现揭示了在线信息生态的快速演变及其对认知安全的深远影响。

原文摘要 · Abstract (English)

Google AI Overviews (AIOs) are arguably the most widely encountered deployment of generative AI, reaching over 2 billion users who may not realize the answers they see are AI-generated. Where search engines have traditionally surfaced ranked sources and left users to evaluate them, AIOs synthesize and deliver a single answer - giving Google unprecedented editorial control over what users read and know. We present a large-scale longitudinal measurement study, issuing 55,393 trending queries across 19 topical categories over a 40-day window (March 13 - April 21, 2026). We report four main findings. First, overall AIO activation is 13.7%, rising to 64.7% for question-form queries, while politically sensitive topics see markedly lower rates. Second, AIO-cited domains are more credible than co-displayed first-page results, yet nearly 30% do not appear in those results at all, indicating a source selection mechanism distinct from Google's ranking algorithm. Third, decomposing responses into 98,020 atomic claims, 11.0% are unsupported by the cited pages - with omission the dominant failure mode - and source quality and claim fidelity are largely independent. Fourth, well over half of AIO-cited pages carry display advertising, meaning publishers lose revenue when AIOs suppress the click-through, even as Google's own sponsored ads continue to appear on the same page. Together, these findings document a rapid transformation of the online information ecosystem whose consequences for epistemic security remain poorly understood.

AI摘要信息生态事实验证算法影响

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。