无需标注数据,用合成查询高效适配多语言重排序模型。
Querit-Reranker: Training Compact Multilingual Rerankers via Efficient Label-Free Distribution Adaptation

- 用教师模型生成软标签,通过合成查询实现无标注分布适应。
- 0.4B参数模型在BEIR上nDCG@10提升至59.28,4B版达SOTA。
- 融合多个检查点,部署时无需集成,适合实际系统使用。
可部署的多语言重排序模型需兼顾跨语言、跨领域与跨任务泛化能力,同时保持高效以作为实际系统中的第二阶段重排序器。然而,将其适配到新目标分布通常需要大量特定任务的相关性标注。我们提出Querit-Reranker,一种基于数据驱动流程的轻量级多语言重排序器训练方法,支持标签高效的分布适应。我们实现了Querit-Reranker-A0.4B(基于0.4B激活参数的自研MoE主干)和Querit-Reranker-4B(基于Qwen3-Embedding-4B初始化)。该流程首先从大规模排序导向数据中学习通用相关性建模,再通过合成查询挖掘结合教师模型得分作为连续软标签进行目标分布适配。为融合不同任务适配的优势,我们采用球面线性插值合并检查点,得到单一可部署模型,避免运行时集成开销。以Qwen3-Embedding-0.6B为第一阶段检索器,Querit-Reranker-A0.4B在BEIR上nDCG@10从54.11提升至59.28,在MIRACL上从59.87提升至67.70;在MTEB Multilingual v2重排序任务中表现媲美更大规模的嵌入模型,而Querit-Reranker-4B更在所有评估模型中达到最优性能。两个模型已发布于Hugging Face。
原文摘要 · Abstract (English)
A deployable multilingual reranker must not only generalize across languages, domains, and ranking tasks, but also remain efficient to serve as a second-stage reranker in practical systems. However, adapting it to new target distributions typically requires extensive task-specific relevance annotations. We present Querit-Reranker, a family of multilingual rerankers trained with a data-centric pipeline for label-efficient adaptation. We instantiate it as Querit-Reranker-A0.4B, initialized from an in-house MoE backbone with 0.4B activated parameters, and Querit-Reranker-4B, initialized from Qwen3-Embedding-4B. Our pipeline first learns general relevance modeling from large-scale ranking-oriented data, then adapts to target distributions through synthetic-query mining with teacher scores as continuous soft labels. To consolidate complementary task-adapted strengths, we further merge checkpoints via spherical linear interpolation, obtaining a single deployable model without runtime ensembling overhead. Using Qwen3-Embedding-0.6B as the first-stage retriever, Querit-Reranker-A0.4B improves average nDCG@10 from 54.11 to 59.28 on BEIR and from 59.87 to 67.70 on MIRACL. On MTEB Multilingual v2 Reranking, it also shows competitive performance with larger embedding-based models, while Querit-Reranker-4B further achieves state-of-the-art performance among all evaluated models. We release both models on Hugging Face.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。