arXiv:2506.02503cs.CL2025-06

让大模型更懂如何处理检索到的错误信息,提升问答准确率。

KARE-RAG: Knowledge-Aware Refinement and Enhancement for RAG

  • 用结构化知识表示帮助模型发现错误
  • 通过优化训练目标修复关键事实错误
  • 小数据也能高效训练,适合实际部署

检索增强生成(RAG)使大语言模型能访问更广泛的知识源,但因检索文档中的噪声,仍存在事实不一致问题。本文提出KARE-RAG,通过三项创新提升知识利用效率:(1) 结构化知识表示,便于训练中检测错误;(2) 密集直接偏好优化(DDPO),优先修正关键错误;(3) 对比式数据生成流程,在修正事实错误的同时保持语义一致性。实验表明,该方法在不同规模模型上显著提升标准RAG性能,涵盖域内与域外任务,且不损害通用能力。改进效果在少量训练数据下即可实现,说明针对性学习策略可实现高效优化。研究为RAG改进提供新方向:提升模型处理检索内容的能力,即可跨多种推理场景增强表现。所有数据与代码将公开于Github。

原文摘要 · Abstract (English)

Retrieval-Augmented Generation (RAG) enables large language models (LLMs) to access broader knowledge sources, yet factual inconsistencies persist due to noise in retrieved documents-even with advanced retrieval methods. We demonstrate that enhancing generative models' capacity to process noisy content is equally critical for robust performance. In this paper, we present KARE-RAG (Knowledge-Aware Refinement and Enhancement for RAG), which improves knowledge utilization through three key innovations: (1) structured knowledge representations that facilitate error detection during training, (2) Dense Direct Preference Optimization (DDPO)-a refined training objective that prioritizes correction of critical errors, and (3) a contrastive data generation pipeline that maintains semantic consistency while rectifying factual inaccuracies. Experiments show our method significantly enhances standard RAG pipelines across model scales, improving both in-domain and out-of-domain task performance without compromising general capabilities. Notably, these gains are achieved with modest training data, suggesting data-efficient optimization is possible through targeted learning strategies. Our findings establish a new direction for RAG improvement: by improving how models learn to process retrieved content, we can enhance performance across diverse inference paradigms. All data and code will be publicly available on Github.

RAG知识纠错高效训练大模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。