arXiv:2502.11770cs.AI2025-02被引 1

让大模型生成更可信:用动态查询优化文档检索

Cognitive-Aligned Document Selection for Retrieval-augmented Generation

  • 通过细粒度对齐查询与文档,动态优化检索结果
  • 在ALCE基准上超越多数基线,实现当前最佳性能
  • 适合需要高可靠性生成的问答与知识应用

大语言模型(LLMs)因生成内容的准确性无法仅依赖参数化知识而易产生幻觉。尽管检索增强生成(RAG)系统通过引入外部文档提升生成模型的准确性和可靠性,但在实际应用中,检索到的文档常不足以支撑模型输出。为此,我们提出GGatrieval(细粒度接地对齐检索),利用大模型动态更新查询并筛选高质量、可靠的检索文档。具体地,将用户查询解析为语法成分,与检索文档进行细粒度对齐;对无法单独对齐的查询成分,设计动态语义补偿机制,迭代重写查询并持续更新检索结果,直至检索文档充分支持回答。该方法引入新文档过滤标准,模拟人类获取目标信息的策略,确保生成内容得到有效支持与验证。在ALCE基准上,该方法显著优于多种基线,达到当前最优水平。

原文摘要 · Abstract (English)

Large language models (LLMs) inherently display hallucinations since the precision of generated texts cannot be guaranteed purely by the parametric knowledge they include. Although retrieval-augmented generation (RAG) systems enhance the accuracy and reliability of generative models by incorporating external documents, these retrieved documents often fail to adequately support the model's responses in practical applications. To address this issue, we propose GGatrieval (Fine-\textbf{G}rained \textbf{G}rounded \textbf{A}lignment Re\textbf{trieval} for verifiable generation), which leverages an LLM to dynamically update queries and filter high-quality, reliable retrieval documents. Specifically, we parse the user query into its syntactic components and perform fine-grained grounded alignment with the retrieved documents. For query components that cannot be individually aligned, we propose a dynamic semantic compensation mechanism that iteratively refines and rewrites the query while continuously updating the retrieval results. This iterative process continues until the retrieved documents sufficiently support the query's response. Our approach introduces a novel criterion for filtering retrieved documents, closely emulating human strategies for acquiring targeted information. This ensures that the retrieved content effectively supports and verifies the generated outputs. On the ALCE benchmark, our method significantly surpasses a wide range of baselines, achieving state-of-the-art performance.

RAG生成可信文档检索大模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。