通过强化模态特异性提升多模态推荐精度
MDE: Modality Discrimination Enhancement for Multi-modal Recommendation
- 设计新融合模块突出不同模态差异
- 在三个数据集上显著优于现有方法
- 适合关注多模态特征区分的研究者
多模态推荐系统通过融合物品在多种模态下的内容特征与用户行为数据来提升性能。有效利用多模态特征需解决两个挑战:保留跨模态的语义共性(模态共享)和捕捉各模态的独特性(模态特定)。现有方法多聚焦于对齐不同模态的特征空间,有助于表示共享特征,但常忽略模态特异性,尤其在模态间存在显著语义差异时。为此,我们提出模态区分增强(MDE)框架,优先提取模态特定信息以提升推荐准确率,同时保持共享特征。MDE通过新颖的多模态融合模块增强模态间差异,并引入节点级权衡机制,平衡跨模态对齐与区分。在三个公开数据集上的大量实验表明,该方法显著优于其他先进方法,证明了联合考虑模态共享与模态特定特征的有效性。
原文摘要 · Abstract (English)
Multi-modal recommendation systems aim to enhance performance by integrating an item's content features across various modalities with user behavior data. Effective utilization of features from different modalities requires addressing two challenges: preserving semantic commonality across modalities (modality-shared) and capturing unique characteristics for each modality (modality-specific). Most existing approaches focus on aligning feature spaces across modalities, which helps represent modality-shared features. However, modality-specific distinctions are often neglected, especially when there are significant semantic variations between modalities. To address this, we propose a Modality Distinctiveness Enhancement (MDE) framework that prioritizes extracting modality-specific information to improve recommendation accuracy while maintaining shared features. MDE enhances differences across modalities through a novel multi-modal fusion module and introduces a node-level trade-off mechanism to balance cross-modal alignment and differentiation. Extensive experiments on three public datasets show that our approach significantly outperforms other state-of-the-art methods, demonstrating the effectiveness of jointly considering modality-shared and modality-specific features.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。