通过双向反馈优化检索与生成,提升跨领域信息检索效果。
Reinforced Information Retrieval
- 检索器与生成器互相学习对方反馈,实现联合优化。
- 在无标注目标域数据上迭代提升,跨领域检索性能显著改善。
- 适合需要高精度跨领域检索的场景,如专业领域知识问答。
尽管检索技术广泛应用,但在跨领域场景中仍面临挑战。近年来,生成增强方法成为解决该问题的有前景方案,通过大语言模型生成器补充原始查询信息,促进相关文档的直接检索。然而,现有方法在需高度领域专业知识的场景下表现不佳。为此,我们提出新型方法 Reinforced-IR,联合适配预训练检索器与生成器,实现精准跨领域检索。其核心创新在于自增强框架,使检索器与生成器基于彼此反馈持续学习:生成器被强化以生成提升检索器性能的查询扩展;检索器则训练为更好识别生成器所定位的相关文档。该迭代过程利用目标领域未标注语料,逐步优化端到端检索性能。实验表明,Reinforced-IR 显著优于现有领域适应方法,在多种应用场景中大幅提升检索质量。
原文摘要 · Abstract (English)
While retrieval techniques are widely used in practice, they still face significant challenges in cross-domain scenarios. Recently, generation-augmented methods have emerged as a promising solution to this problem. These methods enhance raw queries by incorporating additional information from an LLM-based generator, facilitating more direct retrieval of relevant documents. However, existing methods struggle with highly specialized situations that require extensive domain expertise. To address this problem, we present \textbf{Reinforced-IR}, a novel approach that jointly adapts a pre-trained retriever and generator for precise cross-domain retrieval. A key innovation of Reinforced-IR is its \textbf{Self-Boosting} framework, which enables retriever and generator to learn from each other's feedback. Specifically, the generator is reinforced to generate query augmentations that enhance the retriever's performance, while the retriever is trained to better discriminate the relevant documents identified by the generator. This iterative process allows the end-to-end retrieval performance to be progressively optimized using an unlabeled corpus from the target domain. In our experiment, Reinforced-IR outperforms existing domain adaptation methods by a large margin, leading to substantial improvements in retrieval quality across a wide range of application scenarios.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。