arXiv:2508.13843cs.IRcs.AI2025-08中稿 · CIKM2025 as a long…被引 13

统一电商多模态搜索框架,支持图文任意组合检索

UniECS: Unified Multimodal E-Commerce Search Framework with Gated Cross-modal Fusion

  • 采用门控融合机制,灵活处理缺失模态的图文混合检索
  • 在5万对商品数据上实现图文检索提升最高28%(R@10)
  • 轻量级模型仅0.2B参数,实测点击率+2.74%,收入+8.33%

当前电商多模态检索系统存在两大局限:任务优化固定模态配对,且缺乏统一检索的全面评估基准。为此,我们提出UniECS——一个统一的多模态电商搜索框架,可处理图像、文本及其组合的所有检索场景。首先,设计新颖的门控多模态编码器,通过自适应融合机制整合不同模态表示,支持缺失模态情况下的推理。其次,提出综合训练策略,结合跨模态对齐损失(CMAL)、局部一致性损失(CLAL)、同模态对比损失(IMCL)与自适应损失加权。第三,构建了包含5万对商品的多模态基准M-BEER。大量实验表明,UniECS在四个电商基准上均优于现有方法,支持微调或零样本评估。在M-BEER上,图文检索的R@10提升达28%;模型仅0.2B参数,远低于GME-Qwen2VL(2B)和MM-Embed(8B)。在快手电商平台部署后,点击率提升2.74%,收入增长8.33%。代码、模型与数据集将公开于https://github.com/qzp2018/UniECS。

原文摘要 · Abstract (English)

Current e-commerce multimodal retrieval systems face two key limitations: they optimize for specific tasks with fixed modality pairings, and lack comprehensive benchmarks for evaluating unified retrieval approaches. To address these challenges, we introduce UniECS, a unified multimodal e-commerce search framework that handles all retrieval scenarios across image, text, and their combinations. Our work makes three key contributions. First, we propose a flexible architecture with a novel gated multimodal encoder that uses adaptive fusion mechanisms. This encoder integrates different modality representations while handling missing modalities. Second, we develop a comprehensive training strategy to optimize learning. It combines cross-modal alignment loss (CMAL), cohesive local alignment loss (CLAL), intra-modal contrastive loss (IMCL), and adaptive loss weighting. Third, we create M-BEER, a carefully curated multimodal benchmark containing 50K product pairs for e-commerce search evaluation. Extensive experiments demonstrate that UniECS consistently outperforms existing methods across four e-commerce benchmarks with fine-tuning or zero-shot evaluation. On our M-BEER bench, UniECS achieves substantial improvements in cross-modal tasks (up to 28\% gain in R@10 for text-to-image retrieval) while maintaining parameter efficiency (0.2B parameters) compared to larger models like GME-Qwen2VL (2B) and MM-Embed (8B). Furthermore, we deploy UniECS in the e-commerce search platform of Kuaishou Inc. across two search scenarios, achieving notable improvements in Click-Through Rate (+2.74\%) and Revenue (+8.33\%). The comprehensive evaluation demonstrates the effectiveness of our approach in both experimental and real-world settings. Corresponding codes, models and datasets will be made publicly available at https://github.com/qzp2018/UniECS.

多模态检索电商搜索门控融合轻量化模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。