arXiv:2505.13757cs.IRcs.CL2025-05KDD被引 9

用结构化特征压缩文档,提升科学检索的排序效果

CoRank: LLM-Based Compact Reranking with Document Features for Scientific Retrieval

  • 用类别、章节、关键词等紧凑特征替代全文,扩大候选集覆盖
  • 在5个数据集上平均nDCG@10从50.6提升至55.5
  • 无需训练、兼容多种大模型,适合科研检索场景

科学检索对知识发现至关重要。文档重排序在精炼初检结果中起关键作用,但标准LLM列表式重排序在科学领域面临挑战:初检结果常不理想,相关文献排名靠后;传统列表重排序将完整文本纳入上下文窗口,限制可处理候选数量,导致许多相关文献被排除。为此,我们探索基于语义特征的紧凑文档表示(如类别、章节、关键词),提出CoRank——一种无需训练、模型无关的科学检索重排序框架。该框架分三阶段:(i) 离线提取文档特征,(ii) 使用紧凑表示进行粗粒度重排序,(iii) 对第二阶段前Top候选进行全文细粒度重排序。该流程缓解初检不佳问题:紧凑表示使更多文档进入上下文,提升候选覆盖;最终细粒度排序保障排序精度。在5个学术检索数据集上的实验表明,CoRank显著提升不同LLM基座下的重排序性能(平均nDCG@10从50.6升至55.5)。结果凸显信息抽取与信息检索的协同效应,证明结构化语义特征能有效增强科学领域的重排序能力。

原文摘要 · Abstract (English)

Scientific retrieval is essential for advancing scientific knowledge discovery. Within this process, document reranking plays a critical role in refining first-stage retrieval results. However, standard LLM listwise reranking faces challenges in the scientific domain. First-stage retrieval is often suboptimal in the scientific domain, so relevant documents are ranked lower. Meanwhile, conventional listwise reranking places the full text of candidates into the context window, limiting the number of candidates that can be considered. As a result, many relevant documents are excluded before reranking, constraining overall retrieval performance. To address these challenges, we explore semantic-feature-based compact document representations (e.g., categories, sections, and keywords) and propose CoRank, a training-free, model-agnostic reranking framework for scientific retrieval. It presents a three-stage solution: (i) offline extraction of document features, (ii) coarse-grained reranking using these compact representations, and (iii) fine-grained reranking on full texts of the top candidates from (ii). This integrated process addresses suboptimal first-stage retrieval: Compact representations allow more documents to fit within the context window, improving candidate set coverage, while the final fine-grained ranking ensures a more accurate ordering. Experiments on 5 academic retrieval datasets show that CoRank significantly improves reranking performance across different LLM backbones (average nDCG@10 from 50.6 to 55.5). Overall, these results underscore the synergistic interaction between information extraction and information retrieval, demonstrating how structured semantic features can enhance reranking in the scientific domain.

科学检索重排序紧凑表示LLM

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。