arXiv:2603.07023cs.CLcs.AI2026-03

让大模型在长文本中精准找证据并推理,避免被噪音干扰。

Hit-RAG: Learning to Reason with Long Contexts via Preference Alignment

  • 分三阶段优化:先学看懂上下文,再抗干扰,最后稳逻辑推理。
  • 在8个基准上表现显著提升,甚至超过更大模型。
  • 适合需要长文本理解与准确推理的场景,如法律、医疗分析。

尽管检索增强生成(Retrieval-Augmented Generation)能为多模态大模型提供外部知识支持,但在处理长上下文时,常因注意力分散和推理幻觉导致性能下降。信息密度上升使得关键证据被大量噪声淹没,难以识别相关片段。本文提出 extbf{Hit-RAG},一种多阶段偏好对齐框架,通过渐进式优化流程解决这些认知瓶颈。该方法包含三个阶段:首先通过监督微调建立基础的上下文感知能力,减少信息遗漏;其次通过判别式偏好对齐增强对误导性干扰项的鲁棒性;最后通过组相对策略优化稳定逻辑整合,防止推理崩溃。在8个基准上的广泛评估表明,Hit-RAG 持续带来显著性能提升,使模型在长上下文场景中实现从上下文获取到准确推理的有效衔接,并优于许多更大的基线模型。

原文摘要 · Abstract (English)

Despite the promise of Retrieval-Augmented Generation in grounding Multimodal Large Language Models with external knowledge, the transition to extensive contexts often leads to significant attention dilution and reasoning hallucinations. The surge in information density causes critical evidence to be submerged by voluminous noise, which complicates the discernment of relevant fragments within a dense input. In this paper, we propose \textbf{Hit-RAG}, a multi-stage preference alignment framework designed to resolve these cognitive bottlenecks through a progressive optimization pipeline. Our approach systematically refines the utilization of external evidence via three distinct stages. First, Supervised Fine-tuning establishes baseline context awareness to minimize information neglect. Next, Discriminative Preference Alignment enhances robustness against misleading distractors. Finally, Group-Relative Policy Optimization stabilizes logical synthesis to prevent reasoning collapse. Extensive evaluations on eight benchmarks demonstrate that Hit-RAG consistently yields substantial performance gains, enabling models to bridge the gap between context acquisition and accurate reasoning while surpassing much larger counterparts in long-context scenarios.

长文本推理检索增强偏好对齐

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。