提出STAIR模型,融合协同与多模态信息提升电商推荐效果。
STAIR: Manipulating Collaborative and Multimodal Information for E-Commerce Recommendation
- 分步图卷积保留协同与多模态信息共存
- 在三个公开数据集上达到顶尖性能
- 适合关注电商推荐与多模态融合的研究者
尽管多数多模态推荐方法聚焦于模态挖掘,但本文认为,在电商场景中,用户行为很少完全由多模态特征决定,如何充分利用协同信息与多模态信息至关重要。现有方法面临两大挑战:1)模态消融——传统图卷积虽适用于协同过滤,却会抹除多模态信息;2)模态遗忘——推荐损失主要促进协同信息学习,导致多模态信息逐渐被忽略。为此,我们提出STAIR模型,采用新颖的分步图卷积(STepwise grAph convolution),实现协同与多模态信息在电商推荐中的共存。模型以原始多模态特征初始化,并通过约束嵌入更新显著缓解遗忘问题。实验表明,STAIR在三个公开电商数据集上均取得当前最优性能,且计算与内存开销极低。代码已开源:https://github.com/yhhe2004/STAIR。
原文摘要 · Abstract (English)
While the mining of modalities is the focus of most multimodal recommendation methods, we believe that how to fully utilize both collaborative and multimodal information is pivotal in e-commerce scenarios where, as clarified in this work, the user behaviors are rarely determined entirely by multimodal features. In order to combine the two distinct types of information, some additional challenges are encountered: 1) Modality erasure: Vanilla graph convolution, which proves rather useful in collaborative filtering, however erases multimodal information; 2) Modality forgetting: Multimodal information tends to be gradually forgotten as the recommendation loss essentially facilitates the learning of collaborative information. To this end, we propose a novel approach named STAIR, which employs a novel STepwise grAph convolution to enable a co-existence of collaborative and multimodal Information in e-commerce Recommendation. Besides, it starts with the raw multimodal features as an initialization, and the forgetting problem can be significantly alleviated through constrained embedding updates. As a result, STAIR achieves state-of-the-art recommendation performance on three public e-commerce datasets with minimal computational and memory costs. Our code is available at https://github.com/yhhe2004/STAIR.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。