arXiv:2508.07050cs.IRcs.AI2025-08ACL被引 49

让排序模型具备强推理能力,显著提升复杂场景下的文档排序效果。

ReasonRank: Empowering Passage Ranking with Strong Reasoning Ability

  • 通过自动生成带推理标注的数据,训练具备深度推理能力的排序模型。
  • 在多个基准上超越现有方法,且推理延迟远低于传统点对点排序器。
  • 适合需要高精度、强逻辑推理的复杂检索任务,如问答与多跳搜索。

基于大语言模型的列表式排序在诸多文档排序任务中表现出色。随着大推理模型的发展,研究发现测试时进行逐步推理可有效提升排序性能。然而,由于缺乏高质量的推理密集型训练数据,现有重排序器在复杂场景下表现不佳,推理驱动的重排序能力仍不充分。本文提出一种自动化的推理密集型训练数据合成框架,从多样领域获取查询与文档,并利用 DeepSeek-R1 生成高质量训练标签。为增强列表式重排序器的推理能力,进一步设计两阶段训练策略:先进行冷启动监督微调(SFT),再引入强化学习(RL)阶段。在 RL 阶段,提出一种针对多轮列表排序特性的新型多视角排序奖励机制。大量实验表明,所提出的推理密集型重排序器 ReasonRank 显著优于现有基线,并实现远低于点对点重排序器的延迟。代码已开源:https://github.com/8421BCD/ReasonRank。

原文摘要 · Abstract (English)

Large Language Model (LLM) based listwise ranking has shown superior performance in many passage ranking tasks. With the development of Large Reasoning Models (LRMs), many studies have demonstrated that step-by-step reasoning during test-time helps improve listwise ranking performance. However, due to the scarcity of reasoning-intensive training data, existing rerankers perform poorly in many complex ranking scenarios, and the ranking ability of reasoning-intensive rerankers remains largely underdeveloped. In this paper, we first propose an automated reasoning-intensive training data synthesis framework, which sources training queries and passages from diverse domains and applies DeepSeek-R1 to generate high-quality training labels. To empower the listwise reranker with strong reasoning ability, we further propose a two-stage training approach, which includes a cold-start supervised fine-tuning (SFT) stage and a reinforcement learning (RL) stage. During the RL stage, we design a novel multi-view ranking reward tailored to the multi-turn nature of listwise ranking. Extensive experiments demonstrate that our trained reasoning-intensive reranker \textbf{ReasonRank} outperforms existing baselines significantly and also achieves much lower latency than the pointwise reranker. Our codes are available at https://github.com/8421BCD/ReasonRank.

排序模型推理增强大模型应用

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。