提出解耦多模态融合方法,提升推荐系统点击率预测精度
Decoupled Multimodal Fusion for User Interest Modeling in Click-Through Rate Prediction
- 分离处理用户行为与多模态特征,实现细粒度交互建模
- 在Lazada平台部署后,CTCVR提升5.30%,GMV提升7.43%
- 计算开销极低,适合工业级推荐系统应用
现代工业推荐系统通过将预训练模型的多模态表示融入基于ID的点击率(CTR)预测框架来提升性能。然而,现有方法多采用以模态为中心的建模策略,独立处理基于ID和多模态的嵌入表示,难以捕捉内容语义与行为信号间的细粒度交互。本文提出解耦多模态融合(DMF)方法,引入模态增强型建模策略,实现基于ID的协同表示与多模态表示之间的细粒度交互,用于用户兴趣建模。具体地,构建目标感知特征以弥合不同嵌入空间间的语义差距,并将其作为辅助信息增强用户兴趣建模效果。同时设计推理优化的注意力机制,在注意力层前解耦目标感知特征与基于ID嵌入的计算,缓解引入目标感知特征带来的计算瓶颈。为实现全面的多模态融合,DMF结合了以模态为中心与模态增强型两种建模策略所学得的用户兴趣表示。在公开及工业数据集上的离线实验验证了DMF的有效性。此外,该方法已成功部署于国际电商平合Lazada的产品推荐系统中,相对提升了5.30%的CTCVR与7.43%的GMV,且计算开销可忽略不计。
原文摘要 · Abstract (English)
Modern industrial recommendation systems improve recommendation performance by integrating multimodal representations from pre-trained models into ID-based Click-Through Rate (CTR) prediction frameworks. However, existing approaches typically adopt modality-centric modeling strategies that process ID-based and multimodal embeddings independently, failing to capture fine-grained interactions between content semantics and behavioral signals. In this paper, we propose Decoupled Multimodal Fusion (DMF), which introduces a modality-enriched modeling strategy to enable fine-grained interactions between ID-based collaborative representations and multimodal representations for user interest modeling. Specifically, we construct target-aware features to bridge the semantic gap across different embedding spaces and leverage them as side information to enhance the effectiveness of user interest modeling. Furthermore, we design an inference-optimized attention mechanism that decouples the computation of target-aware features and ID-based embeddings before the attention layer, thereby alleviating the computational bottleneck introduced by incorporating target-aware features. To achieve comprehensive multimodal integration, DMF combines user interest representations learned under the modality-centric and modality-enriched modeling strategies. Offline experiments on public and industrial datasets demonstrate the effectiveness of DMF. Moreover, DMF has been deployed on the product recommendation system of the international e-commerce platform Lazada, achieving relative improvements of 5.30% in CTCVR and 7.43% in GMV with negligible computational overhead.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。