arXiv:2607.04008cs.CLcs.IR2026-07

限定候选集的检索增强生成系统,提升长文本问答准确率

Candidate-Constrained Retrieval-Augmented Generation for LongEval-RAG: System Design and Empirical Analysis

论文配图:Candidate-Constrained Retrieval-Augmented Generation for LongEval-RAG: System Design and Empirical Analysis
图 1 · 摘自论文原文
  • 用规则切分证据块,结合查询扩展和伪相关反馈提升检索精度
  • 最佳方案在BERTScore、 nugget覆盖率和评分上均领先,达82.3%
  • 适合需要高可解释性和稳定输出的长文本问答场景

我们提出一种针对LongEval-RAG的候选集约束型检索增强生成系统,每个查询对应由组织方提供的候选集,所有检索证据与最终引用必须限于该集合内。系统融合确定性溯源追踪、基于段落的检索、确定性查询扩展、伪相关反馈(PRF)、倒数排名融合(RRF)、轻量级证据重排序、引用感知证据聚合以及可选的MiniLM句级重排序。通过主评价和自动生成诊断协议对十种流水线变体进行评估。主评价显示最强均衡方案为rule-minilm:采用规则分块、查询扩展、PRF、RRF、重排序、引用先验和后期MiniLM句选择。该方案在所有提交中取得最高BERTScore(82.3)、检索精确率、nugget覆盖率及平均得分。结果表明,性能提升主要来自稳定规则证据单元与生成前句级神经选择的结合,而非更复杂的语义或主题切分。补充的LLM判别评估虽有助于早期诊断,但侧重系统不同,凸显多指标评估的必要性。

原文摘要 · Abstract (English)

We present a candidate-constrained retrieval-augmented generation system for LongEval-RAG, where each query is associated with an organizer-provided candidate set and all retrieved evidence and final citations must remain within that set. The system combines deterministic provenance tracking with passage-based retrieval, deterministic query expansion, pseudo-relevance feedback (PRF), reciprocal rank fusion (RRF), lightweight evidence reranking, citation-aware evidence aggregation, and optional MiniLM sentence reranking. We evaluate ten pipeline variants using a primary organizer evaluation and a supplementary self-generated diagnostic protocol. The primary evaluation shows that the strongest balanced variant is rule-minilm: a rule-based chunking pipeline with query expansion, PRF, RRF, reranking, citation prior, and late MiniLM sentence selection. This variant obtains the highest BERTScore, retrieval precision, nugget coverage, and average grade among our submissions. The result suggests that the main gain does not come from more complex semantic or topic-shift chunking, but from pairing stable rule-based evidence units with sentence-level neural selection before generation. The supplementary LLM-judge evaluation remains useful for early diagnosis and additional analysis, but it emphasizes different systems than the primary gold-answer and nugget-based evaluation, highlighting the need for multi-metric RAG evaluation.

RAG检索增强长文本问答候选集约束

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。