arXiv:2608.24091cs.IR2026-08中稿 · CIKM 2026

为电商点击率预测设计原生多模态表示,提升推荐效果。

Native Multimodal Representation Learning for Click-Through Rate Prediction in E-Commerce Scenarios

论文配图:Native Multimodal Representation Learning for Click-Through Rate Prediction in E-Commerce Scenarios
图 1 · 摘自论文原文
  • 从点击数据中挖掘高质量多模态样本,用于编码器精调。
  • 相比端到端训练,新方法在离线与线上测试中均显著提效。
  • 适合需要精准理解商品图文信息的电商推荐场景。

多模态表示已广泛应用于工业级电商推荐系统。由于其强大的语义理解与泛化能力,可提升传统基于稀疏ID的点击率(CTR)预测模型性能。当前多模态应用通常采用两阶段范式:先在特定推荐场景数据上预训练多模态编码器;再用该编码器提取商品多模态表示,并融入CTR预测模型。然而,多模态预训练任务的训练目标与数据分布常与下游CTR任务不一致,限制了多模态表示的效果。本文聚焦于为CTR任务学习原生多模态表示。直观解法是将多模态编码器与CTR模型在CTR任务上端到端联合训练,期望编码器自动学习下游相关知识。但实验发现,此方法未能带来性能提升。分析表明,原始CTR数据中的用户行为受多模态语义与非多模态因素共同驱动,导致监督信号模糊、编码器更新不一致。为此,我们提出Mine-Then-Train方法,从CTR数据中挖掘高质、可多模态解释的训练样本,用于微调多模态编码器,使其更贴合用户点击偏好。离线与线上实验验证了该方法的有效性。

原文摘要 · Abstract (English)

Multimodal representations have been widely adopted in industrial e-commerce recommendation systems. Due to their strong semantic understanding and generalization capabilities, they enhance the performance of traditional sparse ID-based Click-Through Rate (CTR) prediction models. Current multimodal application frameworks in the CTR prediction task typically follow a two-stage paradigm: first, pre-training a multimodal encoder on data from specific recommendation scenarios; second, extracting items' multimodal representations using this pre-trained multimodal encoder and integrating them into the CTR prediction model. However, the training objectives and data distribution of multimodal pre-training tasks often differ from those of the CTR prediction task, which limits the effectiveness of multimodal representation on downstream tasks. In this paper, we focus on how to learn Native Multimodal Representation for the CTR prediction task. One intuitive solution is to jointly train the multimodal encoder and CTR model end-to-end on the CTR task, with the expectation that the encoder can automatically learn downstream-relevant knowledge. However, we find that the end-to-end training does not bring performance improvements to existing multimodal application paradigms. Our analysis reveals that user behaviors in raw CTR data are driven by both multimodal semantics and non-multimodal factors, leading to ambiguous supervision and inconsistent encoder updates. To address this, we propose a Mine-Then-Train method that mines high-quality, multimodally interpretable training samples from CTR data and uses them to fine-tune the multimodal encoder for better alignment with user click preferences. Offline and online experiments demonstrate the effectiveness of our approach.

多模态点击率预测电商推荐

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。