分离模态共性和个性信息,动态融合提升推荐效果
D3ER: Supporting Multi-Modal Recommendation via Disentangle and Distillation-based Dynamic Ensemble

- 用梯度提升分离并分治学习模态共性与个性特征
- 在多个真实数据集上显著优于现有方法
- 适合需要精细建模多模态信息的推荐系统研究者
将多模态共享信息融入统一表示,多模态推荐(MR)已展现出优于传统单模态推荐的效果。尽管已有方法尝试提取各模态特有信息,但现有方法存在核心缺陷:联合学习模态共性判别信息(HOI)与模态异质判别信息(HEI)会削弱二者各自的表现。为此,我们提出一种新方法——基于解耦与蒸馏的动态集成多模态推荐(D3ER)。首次在多模态推荐中引入梯度提升,以交替优化方式分别学习HOI与HEI,使各模型专注自身擅长样本,实现专业化优化。为进一步缓解梯度提升固有的高存储开销和局部最优风险,我们引入知识蒸馏与全局校正正则化。在多个主流真实数据集上的实验验证了该方法的有效性。
原文摘要 · Abstract (English)
Incorporating items' information shared among multiple modalities into a fused representation, multi-modal recommendation (MR) has demonstrated documented success than canonical unimodal recommendation. Although several attempts have been made to extract the discriminative information unique in each modality, existing methods suffer from a core limitation: the joint learning of modal-homogeneity discriminative information (HOI) and modal-heterogeneity discriminative information (HEI) tends to weaken their individual effectiveness. To remedy this deficiency, we propose a novel method, dubbed Disentangle and Distillation-based Dynamic Ensemble for multi-modal Recommendation (D3ER). We introduce gradient boosting into MR for the first time to formalize the optimization objective for alternately learning HOI and HEI. This design enables models dedicated to each type of information to focus on their proficient samples, thereby promoting specialized optimization. Furthermore, to mitigate the inherent high storage cost and risk of local optima in gradient boosting, we enhance our framework with knowledge distillation and a global correction regularization. Experiments on prevalent real-world datasets confirm the superiority of our proposed method on MR.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。