用超复数嵌入增强多模态推荐的特征表达与跨模态关联。
Hypercomplex Prompt-aware Multimodal Recommendation
- 用超复数嵌入表示多模态特征,提升表达多样性。
- 通过超复数乘法建模非线性跨模态关系,缓解过平滑问题。
- 适合需要精准多模态融合的推荐系统研究者。
现代推荐系统面临信息过载与多模态表征学习固有局限的双重挑战。现有方法存在三大缺陷:(1) 单一表征难以充分表达丰富的多模态特征;(2) 线性模态融合策略忽略模态间的深层非线性相关性;(3) 静态优化方法无法动态缓解图卷积网络(GCN)中的过平滑问题。为此,我们提出HPMRec——一种超复数提示感知多模态推荐框架。该框架采用多分量超复数嵌入,增强多模态特征的表征多样性;利用超复数乘法自然建立跨模态非线性交互,有效弥合语义鸿沟,挖掘跨模态特征。同时引入提示感知补偿机制,缓解分量与模态特异性特征损失之间的错位,从根本上缓解过平滑问题。此外,设计自监督学习任务以增强表征多样性并对齐不同模态。在四个公开数据集上的大量实验表明,HPMRec实现了当前最优的推荐性能。
原文摘要 · Abstract (English)
Modern recommender systems face critical challenges in handling information overload while addressing the inherent limitations of multimodal representation learning. Existing methods suffer from three fundamental limitations: (1) restricted ability to represent rich multimodal features through a single representation, (2) existing linear modality fusion strategies ignore the deep nonlinear correlations between modalities, and (3) static optimization methods failing to dynamically mitigate the over-smoothing problem in graph convolutional network (GCN). To overcome these limitations, we propose HPMRec, a novel Hypercomplex Prompt-aware Multimodal Recommendation framework, which utilizes hypercomplex embeddings in the form of multi-components to enhance the representation diversity of multimodal features. HPMRec adopts the hypercomplex multiplication to naturally establish nonlinear cross-modality interactions to bridge semantic gaps, which is beneficial to explore the cross-modality features. HPMRec also introduces the prompt-aware compensation mechanism to aid the misalignment between components and modality-specific features loss, and this mechanism fundamentally alleviates the over-smoothing problem. It further designs self-supervised learning tasks that enhance representation diversity and align different modalities. Extensive experiments on four public datasets show that HPMRec achieves state-of-the-art recommendation performance.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。