arXiv:2508.04247cs.IRcs.MM2025-08中稿 · ed被引 3

解决多模态推荐中缺失图像和描述的问题,提升模型鲁棒性。

I$^3$-MRec: Invariant Learning with Information Bottleneck for Incomplete Modality Recommendation

  • 用不变学习+信息瓶颈,让模型在缺模态时仍能稳定推荐。
  • 在三个真实数据集上超越现有方法,缺图缺文场景下表现更优。
  • 适合做电商、内容平台等实际推荐系统,应对不完整数据。

多模态推荐系统通过融合多种模态的语义信息提升性能,但现实中常因图像缺失或描述不全导致模型鲁棒性和泛化能力下降。为此,本文提出 I$^3$-MRec,一种基于不变学习与信息瓶颈原理的不完整模态推荐方法。该方法通过两个核心机制:一是跨模态偏好不变性,确保用户偏好在不同模态环境下保持一致;二是紧凑有效的多模态表示,降低对不可靠模态信息的依赖。将每种模态视为独立语义环境,利用不变风险最小化(IRM)学习偏好导向表示;同时设计缺失感知融合模块,显式模拟模态缺失场景。基于信息瓶颈(IB)原则,该模块在压缩模态特异性信息的同时保留关键用户偏好信号。在三个真实世界数据集上的大量实验表明,I$^3$-MRec 在多种模态缺失情形下持续优于当前最先进的多模态推荐方法,展现出出色的实用性与鲁棒性。

原文摘要 · Abstract (English)

Multimodal recommender systems (MRS) improve recommendation performance by integrating complementary semantic information from multiple modalities. However, the assumption of complete multimodality rarely holds in practice due to missing images and incomplete descriptions, hindering model robustness and generalization. To address these challenges, we introduce a novel method called \textbf{I$^3$-MRec}, which uses \textbf{I}nvariant learning with \textbf{I}nformation bottleneck principle for \textbf{I}ncomplete \textbf{M}odality \textbf{Rec}ommendation. To achieve robust performance in missing modality scenarios, I$^3$-MRec enforces two pivotal properties: (i) cross-modal preference invariance, ensuring consistent user preference modeling across varying modality environments, and (ii) compact yet effective multimodal representation, as modality information becomes unreliable in such scenarios, reducing the dependence on modality-specific information is particularly important. By treating each modality as a distinct semantic environment, I$^3$-MRec employs invariant risk minimization (IRM) to learn preference-oriented representations. In parallel, a missing-aware fusion module is developed to explicitly simulate modality-missing scenarios. Built upon the Information Bottleneck (IB) principle, the module aims to preserve essential user preference signals across these scenarios while effectively compressing modality-specific information. Extensive experiments conducted on three real-world datasets demonstrate that I$^3$-MRec consistently outperforms existing state-of-the-art MRS methods across various modality-missing scenarios, highlighting its effectiveness and robustness in practical applications.

多模态推荐缺失模态不变学习信息瓶颈

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。