arXiv:2504.20610cs.IRcs.AI2025-04被引 8

提出RGB模型,量化生成式AI在信息传播中的动态风险。

Information Retrieval in the Age of Generative AI: The RGB Model

  • 构建随机模型模拟新话题下信息的生成与扩散过程。
  • 实证发现高质量回答需大量时间与人力,难以即时生成。
  • 警示快速普及的AI生成内容可能超出现实验证能力。

大型语言模型(LLMs)和生成式AI正深刻改变互联网上的信息检索与处理方式,既带来巨大潜力,也引发对内容真实性与可靠性的担忧。本文提出一种新型定量方法,揭示生成式AI日益普及所引发的复杂信息动态。尽管其对数字生态影响深远,但这些动态仍鲜有研究。我们构建了一个随机模型,刻画新话题下信息的生成、索引与传播过程。这一场景尤其挑战当前依赖实时检索增强生成(RAG)以弥补静态知识局限的LLMs。研究发现,生成式AI的快速采纳与用户依赖程度叠加,可能超越人类验证速度,加剧错误信息在数字资源中的传播风险。对Stack Exchange数据的深入分析证实,高质量回答必然需要大量时间和人工投入才能形成。这凸显了针对新问题生成有说服力文本的巨大风险,并强调未来生成式AI工具需负责任地开发与部署。

原文摘要 · Abstract (English)

The advent of Large Language Models (LLMs) and generative AI is fundamentally transforming information retrieval and processing on the Internet, bringing both great potential and significant concerns regarding content authenticity and reliability. This paper presents a novel quantitative approach to shed light on the complex information dynamics arising from the growing use of generative AI tools. Despite their significant impact on the digital ecosystem, these dynamics remain largely uncharted and poorly understood. We propose a stochastic model to characterize the generation, indexing, and dissemination of information in response to new topics. This scenario particularly challenges current LLMs, which often rely on real-time Retrieval-Augmented Generation (RAG) techniques to overcome their static knowledge limitations. Our findings suggest that the rapid pace of generative AI adoption, combined with increasing user reliance, can outpace human verification, escalating the risk of inaccurate information proliferation across digital resources. An in-depth analysis of Stack Exchange data confirms that high-quality answers inevitably require substantial time and human effort to emerge. This underscores the considerable risks associated with generating persuasive text in response to new questions and highlights the critical need for responsible development and deployment of future generative AI tools.

信息检索生成式AI风险评估

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。