arXiv:2508.21801cs.IR2025-08AAAI

用多模态大模型分组用户点击后行为,提升推荐系统效率与准确率。

DMGIN: How Multimodal LLMs Enhance Large Recommendation Models for Lifelong User Post-click Behaviors

  • 用多模态大模型对长期点击后行为进行分组,减少冗余计算。
  • 在真实广告系统中提升点击率4.7%,每千次展示收入增2.3%。
  • 适合需要高效处理海量用户行为数据的工业级推荐系统。

基于长期用户行为序列建模用户兴趣对提升点击率(CTR)至关重要。然而,长周期点击后行为序列本身带来严重性能问题:数据量庞大导致训练与推理计算成本高、效率低。传统方法采用两阶段策略,但因无法完整利用全序列上下文而削弱模型效果。更重要的是,将多模态嵌入集成到现有大型推荐模型(LRM)中面临巨大挑战:这些嵌入常加剧计算负担,并与LRM架构不匹配。为解决上述问题并提升模型效率与精度,我们提出深度多模态分组兴趣网络(DMGIN)。观察到用户点击后行为序列包含大量重复项目及不同行为与时间戳,DMGIN利用多模态大模型(MLLM)进行分组,更高效地重组完整生命周期点击后行为序列,几乎无额外计算开销,而非直接引入多模态嵌入。为缓解分组带来的信息损失,我们设计两项关键策略:首先,通过兴趣统计与组内变换器分析各组内行为,捕捉群体特征;其次,使用组间变换器对时序排列的组进行建模,捕获用户群体兴趣演化。在工业与公开数据集上的大量实验验证了DMGIN的有效性与高效性。我们在位置服务广告系统中的A/B测试显示,该模型使CTR提升4.7%,每千次展示收入增长2.3%。

原文摘要 · Abstract (English)

Modeling user interest based on lifelong user behavior sequences is crucial for enhancing Click-Through Rate (CTR) prediction. However, long post-click behavior sequences themselves pose severe performance issues: the sheer volume of data leads to high computational costs and inefficiencies in model training and inference. Traditional methods address this by introducing two-stage approaches, but this compromises model effectiveness due to incomplete utilization of the full sequence context. More importantly, integrating multimodal embeddings into existing large recommendation models (LRM) presents significant challenges: These embeddings often exacerbate computational burdens and mismatch with LRM architectures. To address these issues and enhance the model's efficiency and accuracy, we introduce Deep Multimodal Group Interest Network (DMGIN). Given the observation that user post-click behavior sequences contain a large number of repeated items with varying behaviors and timestamps, DMGIN employs Multimodal LLMs(MLLM) for grouping to reorganize complete lifelong post-click behavior sequences more effectively, with almost no additional computational overhead, as opposed to directly introducing multimodal embeddings. To mitigate the potential information loss from grouping, we have implemented two key strategies. First, we analyze behaviors within each group using both interest statistics and intra-group transformers to capture group traits. Second, apply inter-group transformers to temporally ordered groups to capture the evolution of user group interests. Our extensive experiments on both industrial and public datasets confirm the effectiveness and efficiency of DMGIN. The A/B test in our LBS advertising system shows that DMGIN improves CTR by 4.7% and Revenue per Mile by 2.3%.

推荐系统多模态大模型应用工业落地

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。