arXiv:2511.19987cs.CLcs.IR2025-11

让通用重排模型学会领域专精,避免死记硬背

$\text{R}^2\text{R}$: A Route-to-Rerank Post-Training Framework for Multi-Domain Decoder-Only Rerankers

  • 用动态路由选专家,轻量激活适配不同领域
  • 通过隐藏关键实体迫使模型学通用相关性,不依赖表面词
  • 适合金融、法律等高风险领域的精准重排需求

解码器型重排模型在检索增强生成中至关重要。但通用模型在金融、法律等高风险领域缺乏领域特异性,直接微调会导致表面特征过拟合和灾难性遗忘。为此,我们提出R2R框架,结合动态专家路由与两阶段训练策略——实体抽象泛化(EAG)。EAG通过屏蔽最具预测性的表面线索,构建反捷径机制,迫使重排模型学习领域无关的相关性模式而非记忆数据集特定实体。为高效激活领域专家,R2R采用轻量级潜在语义路由,从冻结的骨干解码器内部表示中探测,按查询选择最优LoRA专家。在多种重排器骨干和多领域(法律、医疗、金融)上的实验表明,R2R始终优于通用模型和单领域微调基线。结果证实R2R是一种模型无关、模块化的领域专业化方法,具备强跨域鲁棒性。

原文摘要 · Abstract (English)

Decoder-only rerankers are central to Retrieval-Augmented Generation (RAG). However, generalist models miss domain-specific nuances in high-stakes fields like finance and law, and naive fine-tuning causes surface-form overfitting and catastrophic forgetting. To address this challenge, we introduce R2R, a domain-aware framework that combines dynamic expert routing with a two-stage training strategy, Entity Abstraction for Generalization (EAG). EAG introduces a counter-shortcut mechanism by masking the most predictive surface cues, forcing the reranker to learn domain-invariant relevance patterns rather than memorizing dataset-specific entities. To efficiently activate domain experts, R2R employs a lightweight Latent Semantic Router that probes internal representations from the frozen backbone decoder to select the optimal LoRA expert per query. Extensive experiments across different reranker backbones and diverse domains (legal, medical, and financial) demonstrate that R2R consistently surpasses generalist and single-domain fine-tuned baselines. Our results confirm that R2R is a model-agnostic and modular approach to domain specialization with strong cross-domain robustness.

重排模型领域适应LoRARAG

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。