Qwen3-VL系列实现多模态检索与排序的统一框架,支持跨模态精准搜索。
Qwen3-VL-Embedding and Qwen3-VL-Reranker: A Unified Framework for State-of-the-Art Multimodal Retrieval and Ranking
- 多阶段训练生成高维语义向量,支持灵活嵌入维度和32k-token长输入
- 8B版本在MMEB-V2上达77.8分,刷新多模态嵌入任务记录
- 适合需要跨文本、图像、视频检索的工业级应用开发者
本文介绍Qwen3-VL-Embedding与Qwen3-VL-Reranker模型系列,基于Qwen3-VL基础模型构建,形成端到端高精度多模态搜索框架。该框架将文本、图像、文档图像及视频等多样模态映射至统一表示空间。Qwen3-VL-Embedding采用多阶段训练范式,从大规模对比预训练逐步优化至重排序模型蒸馏,生成语义丰富的高维向量,支持马特罗什卡表示学习(Matryoshka Representation Learning),可灵活调整嵌入维度,处理长达32k token的输入。与此同时,Qwen3-VL-Reranker采用交叉编码器架构结合交叉注意力机制,对查询-文档对进行细粒度相关性评估。两个模型系列继承Qwen3-VL的多语言能力,支持超过30种语言,并以2B和8B参数量版本发布,满足多样化部署需求。实证评估表明,Qwen3-VL-Embedding系列在多个多模态嵌入评测基准上达到顶尖水平。其中,Qwen3-VL-Embedding-8B在MMEB-V2上取得77.8分的综合得分,位居所有模型首位(截至2025年1月8日)。本报告详述了其架构设计、训练方法及实际能力,验证了其在图像-文本检索、视觉问答和视频-文本匹配等多模态检索任务中的有效性。
原文摘要 · Abstract (English)
In this report, we introduce the Qwen3-VL-Embedding and Qwen3-VL-Reranker model series, the latest extensions of the Qwen family built on the Qwen3-VL foundation model. Together, they provide an end-to-end pipeline for high-precision multimodal search by mapping diverse modalities, including text, images, document images, and video, into a unified representation space. The Qwen3-VL-Embedding model employs a multi-stage training paradigm, progressing from large-scale contrastive pre-training to reranking model distillation, to generate semantically rich high-dimensional vectors. It supports Matryoshka Representation Learning, enabling flexible embedding dimensions, and handles inputs up to 32k tokens. Complementing this, Qwen3-VL-Reranker performs fine-grained relevance estimation for query-document pairs using a cross-encoder architecture with cross-attention mechanisms. Both model series inherit the multilingual capabilities of Qwen3-VL, supporting more than 30 languages, and are released in $\textbf{2B}$ and $\textbf{8B}$ parameter sizes to accommodate diverse deployment requirements. Empirical evaluations demonstrate that the Qwen3-VL-Embedding series achieves state-of-the-art results across diverse multimodal embedding evaluation benchmarks. Specifically, Qwen3-VL-Embedding-8B attains an overall score of $\textbf{77.8}$ on MMEB-V2, ranking first among all models (as of January 8, 2025). This report presents the architecture, training methodology, and practical capabilities of the series, demonstrating their effectiveness on various multimodal retrieval tasks, including image-text retrieval, visual question answering, and video-text matching.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。