arXiv:2510.22710cs.AI2025-10AAAI被引 15

通过预检索生成对比问题,提升大模型问答可靠性。

RaCoT: Plug-and-Play Contrastive Example Generation Mechanism for Enhanced LLM Reasoning Reliability

  • 在检索前自动生成语义相近但答案不同的对比问题,引导模型聚焦关键差异点。
  • 在六个基准上比强基线高出0.9-2.4个百分点,对抗测试性能下降仅8.6%。
  • 低延迟(3.12秒)与小词元开销(11.54),适合实时部署。

检索增强生成(RAG)在知识稀疏、语义模糊的长尾查询中面临核心瓶颈,检索噪声会扭曲推理,需昂贵的后处理。为此,我们提出RaCoT(检索感知的思维对比机制),将对比思维提前至检索前阶段。通过自动生成语义相近但答案不同的对比问题,并提取Δ-Prompt捕捉其关键差异,引导模型主动关注决定答案分歧的“关键细节”。该方法可在单次检索中抑制语义干扰,突破单向量查询难以同时编码注意与忽略信号的理论瓶颈。在六个权威基准(包括PopQA和TriviaQA-unfiltered)上,RaCoT优于RankRAG和Self-RAG等强基线0.9-2.4个百分点。其在对抗测试中性能下降仅8.6%,远超其他方法超过15%的衰减。此外,其延迟低至3.12秒,词元开销仅为11.54,处于准确率-效率的帕累托前沿。消融实验验证了各组件必要性。最终,RaCoT将RAG范式从“事后上下文清洗”转变为“先验区分性推理塑造”,为实时、资源受限场景下的可靠AI系统提供高效路径。

原文摘要 · Abstract (English)

Retrieval-Augmented Generation (RAG) faces a core bottleneck with knowledge-sparse and semantically ambiguous long-tail queries, where retrieval noise distorts reasoning and necessitates costly post-processing. To tackle this, we propose RaCoT (Retrieval-aware Contrastive-of-Thought), a novel framework that shifts contrastive thinking to the pre-retrieval stage. By automatically generating a semantically adjacent yet differently answered contrastive question and extracting a $Δ$-Prompt to capture their key differences, RaCoT guides the model to proactively focus on the ``critical details that determine answer divergence." This approach allows it to suppress semantic interference within a single retrieval pass, overcoming the theoretical bottleneck of single-vector queries that struggle to simultaneously encode signals for what to attend to and what to ignore. On six authoritative benchmarks, including PopQA and TriviaQA-unfiltered, RaCoT outperforms strong baselines like RankRAG and Self-RAG by 0.9-2.4 percentage points. It exhibits superior robustness, with a performance drop of only 8.6\% in adversarial tests, far surpassing the over 15\% degradation in other methods. Furthermore, its low latency (3.12s) and token overhead (11.54) place it on the accuracy-efficiency Pareto frontier, while ablation studies validate the necessity of each component. Ultimately, RaCoT reframes the RAG paradigm from ``post-hoc context cleaning" to ``a priori shaping of discriminative reasoning", offering an efficient and robust path toward reliable AI systems for real-time, resource-constrained deployments.

大模型RAG推理增强对比学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。