用主题建模和关键词引导,让大模型生成更全面、不重复的查询,提升检索效果。
Doc2Query++: Topic-Coverage based Document Expansion and its Application to Dense Retrieval via Dual-Index Fusion
- 先用无监督主题建模提取文档潜在主题,再结合关键词筛选生成多样化查询。
- 在多个数据集上,稀疏与稠密检索均显著优于现有方法,最高提升达12.7% MAP。
- 提出双索引融合策略,避免拼接查询带来的噪声,适合实际检索系统部署。
通过查询生成实现文档扩展可缓解稀疏检索中的词汇不匹配问题,但存在生成失控导致幻觉或冗余查询、域内训练泛化至域外(如BEIR)能力差、拼接查询干扰稠密检索等局限。尽管大语言模型可实现跨域生成,但基础提示缺乏控制,基于分类体系的方法依赖特定领域结构。为此,我们提出Doc2Query++:首先利用无监督主题建模推断文档隐含主题,实现跨域适用;再通过混合关键词选择生成每篇文档的多样且相关关键词集,引导大模型在保留关键词基础上减少冗余;为避免稠密检索中查询拼接引入噪声,提出双索引融合策略,分离文本与查询信号。大量实验表明,该方法在多种数据集上的稀疏与稠密检索任务中均显著超越当前最优基线,在MAP、nDCG@10、Recall@100指标上取得显著提升,最高增益达12.7%。
原文摘要 · Abstract (English)
Document expansion (DE) via query generation tackles vocabulary mismatch in sparse retrieval, yet faces limitations: uncontrolled generation producing hallucinated or redundant queries with low diversity; poor generalization from in-domain training (e.g., MS MARCO) to out-of-domain data like BEIR; and noise from concatenation harming dense retrieval. While Large Language Models (LLMs) enable cross-domain query generation, basic prompting lacks control, and taxonomy-based methods rely on domain-specific structures, limiting applicability. To address these challenges, we introduce Doc2Query++, a DE framework that structures query generation by first inferring a document's latent topics via unsupervised topic modeling for cross-domain applicability, then using hybrid keyword selection to create a diverse and relevant keyword set per document. This guides LLM not only to leverage keywords, which ensure comprehensive topic representation, but also to reduce redundancy through diverse, relevant terms. To prevent noise from query appending in dense retrieval, we propose Dual-Index Fusion strategy that isolates text and query signals, boosting performance in dense settings. Extensive experiments show Doc2Query++ significantly outperforms state-of-the-art baselines, achieving substantial gains in MAP, nDCG@10 and Recall@100 across diverse datasets on both sparse and dense retrieval.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。