用多语言大模型提升跨语言检索效果,让不同语言间信息查找更准确。
Bridging Language Gaps: Advances in Cross-Lingual Information Retrieval with Multilingual LLMs
- 用多语言大模型直接对齐跨语言语义,避免依赖翻译
- 相比传统方法,检索准确率显著提升,支持生成答案
- 适合研究跨语言信息检索与多语言AI系统的设计者
跨语言信息检索(CLIR)旨在从与查询语言不同的文档中检索相关内容。传统方法通常将任务视为单语检索结合翻译,将检索与跨语言能力割裂处理。当前主流流程包括查询扩展、排序、重排序,日益融合问答。近年研究转向基于嵌入的范式,利用多语言大模型(LLMs),但跨语言表征对齐仍是核心挑战。跨语言嵌入与多语言大模型的出现带来新范式,显著提升检索性能,并支持答案生成。本综述系统梳理了从早期翻译方法到前沿嵌入驱动与生成技术的发展脉络,详细阐述了核心组件、评估实践与可用资源。识别出数据不平衡与语言差异等持续挑战,提出推动公平高效跨语言检索的未来方向。通过将CLIR置于信息检索与多语言处理的整体图景中,本文不仅总结现有能力,还勾勒出鲁棒、包容、可适应的检索系统发展路径。
原文摘要 · Abstract (English)
Cross-lingual information retrieval (CLIR) addresses the challenge of retrieving relevant documents written in languages different from that of the original query. Research in this area has typically framed the task as monolingual retrieval augmented by translation, treating retrieval methods and cross-lingual capabilities in isolation. Both monolingual and cross-lingual retrieval usually follow a pipeline of query expansion, ranking, re-ranking and, increasingly, question answering. Recent advances, however, have shifted from translation-based methods toward embedding-based approaches and leverage multilingual large language models (LLMs), for which aligning representations across languages remains a central challenge. The emergence of cross-lingual embeddings and multilingual LLMs has introduced a new paradigm, offering improved retrieval performance and enabling answer generation. This survey provides a comprehensive overview of developments from early translation-based methods to state-of-the-art embedding-driven and generative techniques. It presents a structured account of core CLIR components, evaluation practices, and available resources. Persistent challenges such as data imbalance and linguistic variation are identified, while promising directions are suggested for advancing equitable and effective cross-lingual information retrieval. By situating CLIR within the broader landscape of information retrieval and multilingual language processing, this work not only reviews current capabilities but also outlines future directions for building retrieval systems that are robust, inclusive, and adaptable.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。