让多语言检索结果更懂语言一致性,提升生成质量
LAMAR: An Open Language-Aware Multilingual Alignment Reranker

- 用英语锚定相关性,统一跨语言评分标准
- 引入语言偏好对齐,同语种文档排名更高
- 适合需要精准语言匹配的多语言问答场景
在多语言检索增强生成流程中,嵌入模型可检索多语言相关文档,随后进行重排序以生成答案。然而现有重排序器在语义相关文档跨语言存在时,未一致优先选择与查询同语种的文档,尽管语言会影响生成结果。我们分析发现此问题,并发布LAMAR——一种兼顾语义相关性与语言一致性的多语言交叉编码器。LAMAR首先通过英语锚定的相关性蒸馏,实现跨语言输入的一致评分;再通过偏好对齐,鼓励与查询同语种的文档获得更高排名,同时保持语义相关性。在控制实验中,LAMAR在整体及各语言上均表现最佳;在标准多语言重排序基准上也保持竞争力。实际检索设置下,其在所有报告指标上均取得最优结果,证明其在保障通用性能的同时有效建模语言一致性。
原文摘要 · Abstract (English)
In multilingual retrieval augmented generation pipelines, an embedding model can retrieve relevant documents written in multiple languages, which are subsequently reranked before answer generation. However, it remains unclear whether existing multilingual rerankers consider document language when ordering semantically relevant candidates. Our analysis shows that these rerankers do not consistently prioritize documents written in the same language as the query when semantically equivalent documents are available across languages, even though document language can affect answer generation. We release LAMAR, a language aware multilingual cross encoder trained to account for both semantic relevance and language coherence. LAMAR first uses English anchored relevance distillation to establish consistent relevance scoring across multilingual inputs and then applies preference alignment for language coherence to encourage documents written in the same language as the query to receive higher rankings while retaining semantic relevance. In a controlled experiment designed to assess language coherence, LAMAR achieves the best performance overall and across all languages examined individually. LAMAR also remains competitive on established multilingual reranking benchmarks. In practical retrieval settings, LAMAR achieves the best results across all reported metrics when reranking candidates retrieved in the first stage. These results demonstrate that LAMAR accounts for language coherence while achieving strong performance on general multilingual reranking benchmarks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。