arXiv:2605.29287cs.IRcs.CV2026-05KDD

统一模型提升多模态内容检索精度与效率

UniNote: A Unified Embedding Model for Multimodal Representation and Ranking

论文配图:UniNote: A Unified Embedding Model for Multimodal Representation and Ranking
图 1 · 摘自论文原文
  • 设计统一嵌入模型,兼顾全局表征与局部细节
  • 两阶段训练:对比监督微调+强化学习优化排序
  • 在小红书落地,检索质量与成本双优

物品到物品(I2I)检索是现代内容平台的核心功能,支撑推荐系统与内容审核等关键业务。尽管多模态嵌入方法在通用检索中取得进展,但在I2I场景中仍面临三大挑战:全局表征与细粒度检索的平衡难题、解耦嵌入-排序流程的系统性低效,以及模型精度与服务延迟之间的固有权衡。为此,我们提出 extbf{UniNote},一个专为工业级I2I检索设计的统一嵌入模型。通过引入定制化检索策略,支持在不同粒度下对复杂多模态内容进行表示学习。为实现该策略,UniNote采用两阶段训练范式:第一阶段使用对比监督微调建立稳健的基础嵌入;第二阶段通过强化学习(RL)过程优化排序质量,使模型更贴近内容相关性。实验表明,UniNote在多种I2I任务中达到最优性能。已在小红书部署,并与马特约什卡表征学习(MRL)集成,在大规模应用中显著提升检索质量与成本效率。

原文摘要 · Abstract (English)

Item-to-Item (I2I) retrieval is a fundamental part of modern content platforms, supporting critical industrial workflows from recommendation engines to content auditing. While multimodal embedding methods have advanced general retrieval, they often falter in I2I scenarios due to the challenges of balancing global content representation with fine-grained local retrieval, the systemic inefficiency of decoupled embedding-and-ranking pipelines, and the inherent trade-offs between model precision and serving latency. To solve these issues, we propose \textbf{UniNote}, a unified embedding model designed for industrial I2I retrieval. Tailored retrieval strategies are introduced to support representation learning over complex, multimodal content at varying granularities. To operationalize these strategies, UniNote employs a two-stage training paradigm: the first stage leverages contrastive SFT to establish robust base embeddings, while the second stage refines ranking quality through a reinforcement learning (RL) process that aligns the model with content relevance. Our results show that UniNote achieves SOTA performance across diverse I2I tasks. Deployed at Xiaohongshu and integrated with Matryoshka Representation Learning (MRL), UniNote achieved significant improvements in retrieval quality and cost efficiency in large-scale applications.

多模态检索统一模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。