让检索器更懂答案:通过知识图谱引导的渐进式训练,提升长文本问答的精准度。
ARK: Answer-Centric Retriever Tuning via KG-augmented Curriculum Learning
- 用大模型构建知识图谱生成增强查询,逐步引入难负例训练检索器。
- 在10个长文本数据集上相比基线提升14.5%,且无需改动模型结构。
- 适合需要高精度长上下文问答的场景,如智能客服、科研助手。
检索增强生成(RAG)在知识密集型任务中表现强劲,但在长上下文场景下常受限于检索器难以识别稀疏但关键的证据。传统检索器以查询-文档相似度为目标,与生成精确答案的下游任务不一致。为此,我们提出一种面向答案对齐的检索器微调框架。首先,通过评估片段是否足以生成正确答案,筛选高质量正样本;随后采用基于课程学习的对比学习策略,利用大模型构建的知识图谱生成增强查询,挖掘逐级困难的硬负样本。该过程使检索器学会区分答案充分的正样本与细微干扰项,提升泛化能力。在Ultradomain和LongBench基准的10个数据集上实验表明,所提方法显著优于基线模型,性能提升达14.5%,且保持高效,无需复杂架构修改。代码已开源。
原文摘要 · Abstract (English)
Retrieval-Augmented Generation (RAG) has emerged as a powerful framework for knowledge-intensive tasks, yet its effectiveness in long-context scenarios is often bottlenecked by the retriever's inability to distinguish sparse yet crucial evidence. Standard retrievers, optimized for query-document similarity, frequently fail to align with the downstream goal of generating a precise answer. To bridge this gap, we propose a novel fine-tuning framework that optimizes the retriever for Answer Alignment. Specifically, we first identify high-quality positive chunks by evaluating their sufficiency to generate the correct answer. We then employ a curriculum-based contrastive learning scheme to fine-tune the retriever. This curriculum leverages LLM-constructed Knowledge Graphs (KGs) to generate augmented queries, which in turn mine progressively challenging hard negatives. This process trains the retriever to distinguish the answer-sufficient positive chunks from these nuanced distractors, enhancing its generalization. Extensive experiments on 10 datasets from the Ultradomain and LongBench benchmarks demonstrate that our fine-tuned retriever achieves state-of-the-art performance, improving 14.5\% over the base model without substantial architectural modifications and maintaining strong efficiency for long-context RAG. Our work presents a robust and effective methodology for building truly answer-centric retrievers. Source Code is available on https://github.com/valleysprings/ARK/.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。