RAG模型需突破事实导向,学会表达多元观点。
Retrieval-Augmented Generation Must Move Beyond Factual Grounding to Represent Diverse Opinions
- 引入不确定性量化框架,区分事实与观点查询的生成目标。
- 提出O-RAG架构,实现观点提取与实体关联的元数据支持。
- 在电商和酒店评论中提升观点多样性42.7%,人类偏好达79.2%。
本文指出,检索增强生成(RAG)系统存在事实偏见:其优化目标聚焦于减少认知不确定性,却忽视了观点丰富内容中的随机不确定性。对34个主流RAG基准的调查显示,仅1个涉及观点合成,表明该偏见根植于数据集、检索-生成目标及评估指标。这不仅带来技术局限,更引发信息茧房风险,导致主导观点被放大,少数声音被压制。本文从不确定性量化视角建模,提出事实查询应最小化后验熵,而观点查询应保持熵值。基于Wasserstein距离构建统一目标,兼顾覆盖度、保真度与公平性。作为可行性证明,提出意见感知型RAG(O-RAG),包含大模型观点抽取与实体链接的观点元数据。在电商卖家论坛与公开酒店评论两个领域验证,实验显示其在语义分布上相比原始数据降低18%-48% Wasserstein距离,情感多样性提升26.8%,实体匹配率提高42.7%。人工评估中,79.2%的样本更倾向意见增强生成结果。本文呼吁研究界重视观点代表性,并主张随着RAG成为信息访问核心中介,其呈现多元视角的能力至关重要。
原文摘要 · Abstract (English)
This position paper argues that Retrieval-Augmented Generation (RAG) systems exhibit a factual bias-optimizing for epistemic uncertainty reduction while ignoring the aleatoric uncertainty inherent in opinion-rich content. This misalignment demands a paradigm shift in RAG system design. A survey of 34 major RAG benchmarks reveals that only one addresses opinion synthesis, confirming that the bias is structural and embedded in datasets, retrieval-generation objectives, and evaluation metrics alike. Beyond technical limitations, this bias poses risks to transparent and accountable AI. Namely, echo chamber effects that amplify dominant viewpoints, which can lead to opinion manipulation and under-representation of minority voices. We formalize the problem through the lens of uncertainty quantification, showing that factual queries should minimize posterior entropy while opinion queries must preserve it. We derive a unified objective over coverage, fidelity, and fairness using the Wasserstein distance. As an existence proof, we present Opinion-Aware RAG (O-RAG), an architecture featuring LLM-based opinion extraction and entity-linked opinion metadata. We evaluate it across two domains -- e-commerce seller forums and public hotel reviews. Experiments demonstrate 18-48% reduction in Wasserstein distance to corpus-level sentiment distributions, +26.8% sentiment diversity, and +42.7% entity match rate. Human evaluators preferred opinion-enriched generation 79.2% of the time. We propose a research agenda and argue that as RAG systems increasingly mediate access to information, their ability to represent diverse perspectives is of the essence.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。