arXiv:2605.31171cs.IRcs.AI2026-05

用单语目标提升多语言检索效果,解决跨语言对齐难题。

MIMO: Multilingual Information Retrieval via Monolingual Objectives

论文配图:MIMO: Multilingual Information Retrieval via Monolingual Objectives
图 1 · 摘自论文原文
  • 以英语语义空间为锚点,通过知识蒸馏初始化跨语言对齐。
  • 联合优化蒸馏与对比学习,提升检索精度并保持语义一致性。
  • 在多种多语言和单语基准上均超越现有方法,适合实际跨语言搜索场景。

多语言信息检索(MLIR)模拟了查询与文档分属不同语言的真实搜索场景。现有嵌入模型主要针对多单语检索优化,其在MLIR设置下性能常下降。直接应用传统对比学习会加剧语言聚类,并在跨语言对齐与嵌入均匀性之间产生权衡。为此,我们提出MIMO:基于单语目标的多语言信息检索框架。该框架分两阶段进行:首先利用高性能教师模型稳定的英语语义空间作为锚点,通过知识蒸馏初始化学生模型的跨语言对齐;随后联合优化蒸馏损失与跨语言对比损失,增强检索判别能力同时保持对齐。大量实验表明,MIMO在多个MLIR与多单语基准上持续优于现有跨语言训练基线,且与同规模或更大参数量的现成模型相比仍具竞争力。进一步的跨语言对齐-均匀性分析揭示了两种损失组件的差异化作用,其组合实现了对齐与均匀性的有利权衡。

原文摘要 · Abstract (English)

Multilingual Information Retrieval (MLIR) reflects real-world search environments in which queries and relevant documents may appear in different languages within a mixed-language corpus. However, existing embedding models are primarily optimized for Multi-Monolingual retrieval and their performance often degrades in MLIR settings. Moreover, directly applying conventional contrastive learning to MLIR can exacerbate language clustering and expose a trade-off between cross-lingual alignment and embedding uniformity. To address these limitations, we propose MIMO: Multilingual Information Retrieval via Monolingual Objectives, a two-stage framework that uses a stable English semantic space from a high-performing teacher model as an anchor. MIMO first initializes the student model's cross-lingual alignment through knowledge distillation, and then jointly optimizes distillation and cross-lingual contrastive learning to improve retrieval discrimination while preserving alignment. Extensive experiments show that MIMO consistently outperforms existing cross-lingual training baselines across various MLIR and Multi-Monolingual benchmarks. MIMO also remains competitive with off-the-shelf models of similar or larger parameter scales. Furthermore, our cross-lingual Alignment-Uniformity analysis clarifies the distinct roles of the two loss components and shows that their combination yields a favorable trade-off between alignment and uniformity.

多语言检索知识蒸馏嵌入对齐

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。