arXiv:2602.17366cs.CL2026-02EMNLP

用往返预测筛选易学数据,提升长尾问答的检索能力

RPDR: A Round-trip Prediction-Based Data Augmentation Framework for Long-Tail Question Answering

  • 通过往返预测识别容易学习的训练样本
  • 在PopQA和EntityQuestion上显著优于BM25和Contriver
  • 适合需要提升罕见知识检索的系统开发者

长尾问答对大语言模型构成重大挑战,因其难以获取和准确回忆较少见的知识。检索增强生成(RAG)系统通过引入外部检索机制展现出巨大潜力。然而,密集检索模型在泛化到稀有或冷门知识时仍面临困难。本文提出RPDR,一种基于往返预测的数据增强框架,用于选择高质量、易学习的训练数据以提升密集检索器性能。该方法包含三个核心组件:合成数据生成、基于往返预测的数据筛选以识别易学实例,以及使用这些实例进行检索器训练。我们在两个长尾检索基准测试集PopQA和EntityQuestion上评估了RPDR,结果表明其在极端长尾类别上显著优于现有检索器如BM25和Contriver。通过详细的人工分析,我们揭示了RPDR的优势与局限,并提出了动态路由机制,可动态将查询分配至专用检索模块,进一步提升检索效果。

原文摘要 · Abstract (English)

Long-tail question answering presents significant challenges for large language models (LLMs) due to their limited ability to acquire and accurately recall less common knowledge. Retrieval-augmented generation (RAG) systems have shown great promise in mitigating this limitation by integrating external retrieval mechanisms. However, dense retrieval models often face the same difficulties when generalizing to rare or niche knowledge. In this study, we introduce RPDR, a novel data augmentation framework that selects high-quality easy-to-learn training data, to enhance dense retrievers. Our approach is built around three core components: synthetic data generation, data selection with Round-Trip prediction to identify easy-to-learn instances, and retriever training with these instances. We evaluate RPDR on two long-tail retrieval benchmarks, PopQA and EntityQuestion, demonstrating substantial improvements over existing retrievers like BM25 and Contriver, especially on extremely long-tail categories. We identify the strengths and limitations of RPDR through detailed human analysis and propose a dynamic routing mechanism to dynamically route queries to specialized retrieval modules to further improve retrieval performance.

长尾问答数据增强检索增强密集检索

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。