arXiv:2604.03014cs.IRcs.AI2026-04

针对用户个性化需求,用生成模型筛选内容特征并捕捉多模态依赖,提升推荐效果。

User-Aware Conditional Generative Total Correlation Learning for Multi-Modal Recommendation

  • 用交互引导的扩散模型为每位用户过滤个性化内容特征。
  • 优化跨模态总相关性下界,在标准数据集上NDCG@5提升最高达28.30%。
  • 适合关注用户差异与多模态协同建模的推荐系统研究者。

多模态推荐通过引入视觉、文本等内容信息增强物品表征,超越仅依赖交互数据的推荐方法。其成功关键在于对齐内容模态与由交互数据推导的用户偏好,但现有主流方法基于解耦不变偏好信号与特定模态噪声,存在缺陷:首先,假设内容对所有用户的相关性一致,违背用户条件偏好事实;其次,分别优化成对对比损失,忽视多个内容模态共同影响用户选择时的高阶依赖关系。本文提出条件生成总相关性学习框架GTC,采用交互引导的扩散模型实现用户感知的内容特征筛选,保留每位用户相关的个性化特征。同时,为捕捉完整的跨模态依赖,优化所有模态表示总相关性的可计算下界。在标准多模态推荐基准上的实验表明,GTC持续优于现有最先进方法,NDCG@5最高提升28.30%。消融实验验证了条件偏好驱动特征过滤与总相关性优化的有效性,证实GTC能有效建模多模态推荐中的用户条件关系。代码已开源:https://github.com/jingdu-cs/GTC。

原文摘要 · Abstract (English)

Multi-modal recommendation (MMR) enriches item representations by introducing item content, e.g., visual and textual descriptions, to improve upon interaction-only recommenders. The success of MMR hinges on aligning these content modalities with user preferences derived from interaction data, yet dominant practices based on disentangling modality-invariant preference-driving signals from modality-specific preference-irrelevant noises are flawed. First, they assume a one-size-fits-all relevance of item content to user preferences for all users, which contradicts the user-conditional fact of preferences. Second, they optimize pairwise contrastive losses separately toward cross-modal alignment, systematically ignoring higher-order dependencies inherent when multiple content modalities jointly influence user choices. In this paper, we introduce GTC, a conditional Generative Total Correlation learning framework. We employ an interaction-guided diffusion model to perform user-aware content feature filtering, preserving only personalized features relevant to each individual user. Furthermore, to capture complete cross-modal dependencies, we optimize a tractable lower bound of the total correlation of item representations across all modalities. Experiments on standard MMR benchmarks show GTC consistently outperforms state-of-the-art, with gains of up to 28.30% in NDCG@5. Ablation studies validate both conditional preference-driven feature filtering and total correlation optimization, confirming the ability of GTC to model user-conditional relationships in MMR tasks. The code is available at: https://github.com/jingdu-cs/GTC.

多模态推荐生成模型用户感知总相关性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。