arXiv:2508.01226cs.IRcs.MM2025-08被引 2

通过校准多模态推荐中的均匀性,提升用户与物品表示的对齐效果。

CM$^3$: Calibrating Multimodal Recommendation

  • 基于多模态相似性动态调整均匀性约束,增强相关物品的表示对齐。
  • 在五个真实数据集上,性能最高提升5.4%(NDCG@20)。
  • 适合关注多模态融合与推荐系统表征优化的研究者。

对比学习中对齐与均匀性是核心原则。现有推荐系统研究表明,优化贝叶斯个性化排序(BPR)损失有助于实现对齐与均匀性:前者使交互过的用户与物品表示靠近,后者要求用户和物品嵌入在单位超球面上分布均匀。本文重新审视多模态推荐系统中的对齐与均匀性,发现现有模型过度强调均匀性而忽视对齐。为此,我们提出新假设——不强制所有物品均匀分布,而是根据其多模态属性相似性,让相似物品在超球面中靠拢,同时增强不同物品间的排斥力。理论分析揭示了该校准均匀性损失与传统形式的关系。为更好融合多模态特征,我们设计了球面贝塞尔方法,支持任意数量模态融合,并保证融合结果位于同一超球面。在五个真实数据集上的实验验证了该方法的优越性,结合大语言模型提取特征后,NDCG@20 最高提升5.4%。代码已公开于 https://github.com/enoche/CM3。

原文摘要 · Abstract (English)

Alignment and uniformity are fundamental principles within the domain of contrastive learning. In recommender systems, prior work has established that optimizing the Bayesian Personalized Ranking (BPR) loss contributes to the objectives of alignment and uniformity. Specifically, alignment aims to draw together the representations of interacting users and items, while uniformity mandates a uniform distribution of user and item embeddings across a unit hypersphere. This study revisits the alignment and uniformity properties within the context of multimodal recommender systems, revealing a proclivity among extant models to prioritize uniformity to the detriment of alignment. Our hypothesis challenges the conventional assumption of equitable item treatment through a uniformity loss, proposing a more nuanced approach wherein items with similar multimodal attributes converge toward proximal representations within the hyperspheric manifold. Specifically, we leverage the inherent similarity between items' multimodal data to calibrate their uniformity distribution, thereby inducing a more pronounced repulsive force between dissimilar entities within the embedding space. A theoretical analysis elucidates the relationship between this calibrated uniformity loss and the conventional uniformity function. Moreover, to enhance the fusion of multimodal features, we introduce a Spherical Bézier method designed to integrate an arbitrary number of modalities while ensuring that the resulting fused features are constrained to the same hyperspherical manifold. Empirical evaluations conducted on five real-world datasets substantiate the superiority of our approach over competing baselines. We also shown that the proposed methods can achieve up to a 5.4% increase in NDCG@20 performance via the integration of MLLM-extracted features. Source code is available at: https://github.com/enoche/CM3.

多模态推荐对比学习嵌入对齐超球面

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。