提出公平检索方法,缓解大模型生成中的偏见问题。
Towards FairRAG: Preventing Representational Harm in Retrieval-Augmented Generation by Enforcing Fair Exposure at Retrieval Time

- 设计暴露感知排序策略,让少数群体内容获得更公平的展示机会。
- 在TREC 2022数据集上实现近似平等的曝光率,显著降低偏见。
- 适合关注AI公平性与可信赖生成的研究者和开发者。
随着大语言模型在高风险领域加速应用,幻觉问题日益突出。检索增强生成(RAG)被用于缓解此问题,但其多组件流水线引入了偏见风险。本研究对比了两种已有效用导向排序策略(标准与随机)及两种新提出的暴露感知方法(强制暴露与代表性随机)。基于包含受保护与非受保护条目标注的TREC 2022 Fair Ranking Dataset,使用四个场景化问答提示测试模型对相关条目的检索与引用生成能力。评估结果显示,代表性随机排序器在统计上实现了接近均等的平均曝光率,承认初始检索得分已受表征偏见影响;而其他方法假设得分无偏。所有排序方法中,生成结果的群体公平性与曝光公平性高度一致,表明RAG系统中的表征偏见源于检索阶段并传递至生成环节。研究强调检索排序是缓解下游偏见的关键点,并提出代表性随机排序器以恢复RAG系统的公平性。
原文摘要 · Abstract (English)
As Large Language Model (LLM) integration has accelerated in high-stakes domains, model hallucination is a critical issue. Retrieval-augmented generation (RAG) is a technique for addressing hallucination; however, RAG's multi-component pipeline introduces vulnerabilities where biases can be introduced. This study considers two previously developed utility-focused ranking strategies (Standard and Stochastic) alongside two proposed exposure-aware approaches (Forced-Exposure and Representative Stochastic). Using the TREC 2022 Fair Ranking Dataset, which contains Wikipedia articles annotated as protected or non-protected, the LLM was asked to identify relevant articles with citations for four scenario-based Q&A prompts. The retrieval rankings and the generated outputs were evaluated for exposure bias and utility across all ranking methods. Overall, the Representative Stochastic ranker resulted in a statistically significant near-parity average exposure, acknowledging that relevance scores initially produced during retrieval are already shaped by representational bias, whereas the other rankers assume those scores are unbiased. Across all the methods of document ranking, generation demographic parity closely mirrored the exposure parity, reinforcing that representational bias in RAG systems is driven by retrieval and propagates to generation. These findings highlight that retrieval ranking is a critical point for mitigating downstream bias and propose a Representative Stochastic ranker that reintroduces fairness in RAG systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。