用证据反推生成可执行的推理路径,让RAG智能体训练更精准。
From Evidence to Trajectory: Abductive Reasoning Path Synthesis for Retrieval-Augmented Generation Agents Development
- 从问题和证据反推可执行的推理步骤,分三阶段构建决策路径
- 80亿参数模型在开放域问答上准确率提升14.7个百分点
- 适合研究RAG智能体、自动推理与数据合成的开发者
检索增强生成(RAG)智能体开发受限于缺乏可执行的智能体-环境交互轨迹。现有数据集提供问题、答案和证据,但缺少对检索调用、动态规划和逐步决策的细粒度监督。强化学习虽有潜力,但常因奖励稀疏和冷启动失败而受限,尤其当基础大语言模型推理能力不足时。现有数据合成方法多生成事后解释,而非可执行轨迹。本文提出EviPath,一种以证据为锚点的推理路径合成范式。EviPath通过三阶段反向工程:(i) 归纳子任务规划,分解问题并制定依赖感知的解决路径;(ii) 真实子问题求解,利用支持证据作为代理环境生成有依据的中间思考与答案;(iii) 对话微调,将完整轨迹转化为对话格式用于监督微调。在主流问答基准上的实验表明,基于合成语料训练的80亿参数模型显著且一致优于现有最先进基线,在开放域问答中实现14.7%的绝对精确匹配提升。
原文摘要 · Abstract (English)
Retrieval-augmented generation (RAG) agent development is hindered by the lack of executable ground-truth agent-environment interaction trajectories. Existing datasets provide questions, answers, and evidence, but lack fine-grained supervision for retriever invocation, dynamic planning, and stepwise decision-making. Reinforcement learning offers a potential solution, but often suffers from sparse rewards and cold-start failures when base large language models (LLMs) lack sufficient reasoning capability. Meanwhile, existing data synthesis methods mainly generate post-hoc rationales rather than executable environment-interaction trajectories. In this paper, we propose EviPath, an evidence-anchored reasoning path synthesis paradigm for RAG agent development. EviPath reverse-engineers executable trajectories from question-answer pairs and supporting evidence through three stages: (i) Abductive Subtask Planning, which decomposes questions and plans dependency-aware solution paths; (ii) Faithful Sub-question Answering, which uses supporting evidence as a proxy environment to generate grounded intermediate thoughts and answers; and (iii) Conversational Fine-Tuning, which converts complete trajectories into a dialogue format for supervised fine-tuning. Experiments on widely used question-answering benchmarks show that an 8B model trained on our synthetic corpus significantly and consistently outperforms state-of-the-art baselines, achieving a 14.7% absolute Exact Match gain in open-domain question answering.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。