arXiv:2606.30518cs.CL2026-06被引 1

让AI在知识冲突时更可靠,通过分场景训练专用助手提升生成质量。

Regime-Aware Peer Specialization for Robust RAG under Heterogeneous Knowledge Conflicts

论文配图:Regime-Aware Peer Specialization for Robust RAG under Heterogeneous Knowledge Conflicts
图 1 · 摘自论文原文
  • 按冲突类型分三类,为每类训练专属助手,精准指导不同情况。
  • 在五个冲突场景中超越所有基线方法,最高提升18.3%(BLEU)。
  • 适合需要高可靠性的AI系统,如医疗、金融问答等关键领域。

检索增强生成(RAG)通过引入外部上下文提升语言模型表现,但在检索内容与模型参数知识冲突时易失效。此类冲突存在可靠性谱系,涵盖可信、部分可信到对抗性上下文。现有方法常采用不分场景的统一监督,导致不兼容学习信号混淆。为此,我们提出RAPS-DA:一种基于冲突可靠性的分层专用框架,在样本和词元两个层面实现互补优化。在样本层面,将冲突划分为接地、仲裁、抵抗三类,从同一基础模型中训练同规模专用助手,每个样本被硬路由至对应助手进行策略内反KL监督;在词元层面,设计双层选择器,利用教师间分歧、学生-教师差异及学生熵,过滤无效或不稳定词元,强化高置信度错误词元,并随学生训练成熟逐步聚焦于高冲突词元。性能提升源于固定模型规模下的专业化,非依赖更强教师,且专用助手仅用于训练,部署阶段无需配置标签或访问同伴。在五种冲突场景及两个分布外基准上,RAPS-DA全面超越提示、解码、微调、强化学习及单教师基线方法。

原文摘要 · Abstract (English)

Retrieval-augmented generation (RAG) improves language models by grounding generation in external context. However, it can be fragile when the retrieved context conflicts with the model's parametric knowledge. Such conflicts span a reliability spectrum, ranging from reliable and partially reliable evidence to adversarial context. Existing remedies often handle such heterogeneous conflicts with regime-agnostic supervision, which can conflate incompatible learning signals across reliability regimes. To disentangle these signals, we propose RAPS-DA, a regime-aware peer specialization framework that addresses conflict at two complementary granularities. At the sample level, conflicts are divided into three regimes, including Grounding, Arbitration, and Resistance, with one same-scale peer specialist trained per regime from a shared base model. Each sample is then hard-routed to its regime-matched peer for on-policy reverse-KL supervision. At the token level, a dual-layer selector uses inter-teacher disagreement, student-teacher divergence, and student entropy to filter uninformative or unstable tokens, upweight confidently misaligned ones, and gradually focus supervision on high-conflict tokens as the student matures. Gains stem from specialization at a fixed model scale, not from a stronger teacher, and the peer specialists exist only during training, so the deployed student requires no regime labels or peer access. Experiments on five conflict scenarios and two out-of-distribution benchmarks show RAPS-DA surpasses all prompting, decoding, fine-tuning, RL, and single-teacher baselines.

RAG知识冲突专用模型生成鲁棒性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。