arXiv:2607.26720cs.IR2026-07

解决多模态推荐中缺失数据导致的结构失真与推荐偏差问题

CaIRec: Calibrated Modality Imputation for Incomplete Multimodal Recommendation

论文配图:CaIRec: Calibrated Modality Imputation for Incomplete Multimodal Recommendation
图 1 · 摘自论文原文
  • 分两阶段重建缺失模态,先校准跨模态结构,再适配推荐任务
  • 在三个数据集上提升推荐准确率,最坏场景下仍保持稳定性能
  • 适合处理图像/文本缺失的工业级多模态推荐系统

现实中的多模态推荐系统常面临模态缺失问题,即某些项目缺少图像、文本或其他内容特征。这种不完整性削弱了项目表征并降低推荐性能。现有模态补全方法从已有内容估计缺失表示,但存在两大挑战:一是未显式考虑同一项目各模态间的关联,导致跨模态关系不一致,引发跨模态结构失真;二是即使结构合理,补全信息也缺乏排序导向的指导,且模态缺失破坏了偏好传播所需项目邻域,造成偏好适应差距。为此,我们提出校准式不完整多模态推荐框架CaIRec,包含两阶段设计:结构补全校准(SIC)利用可用模态推断共享信息,并通过结构正则化和观测模态对的对应监督校准跨模态组织;偏好导向表征校准(PRC)在表征与关系层面进行推荐特定适配,构建伪缺失实例以对齐补全表示与受排序监督影响的观测表示,并通过融合补全内容关系与协同证据构建完成感知的项目图。在三种数据集、不同模态缺失设置下的大量实验验证了CaIRec的有效性与鲁棒性。

原文摘要 · Abstract (English)

Real-world multimodal recommender systems often face incomplete modality observations, where items lack images, text, or other content features. Such incompleteness weakens item representations and degrades recommendation performance. Existing modality imputation methods estimate missing representations from available item content, but two challenges remain. First, they optimize the recovered representation itself without explicitly considering its relations with other modalities of the same item. The completed modalities may therefore form inconsistent cross-modal relations, causing Cross-modal Structural Distortion. Second, even structurally coherent recovered information may remain ineffective for personalized ranking. Recovered representations receive limited ranking-oriented guidance, while modality missingness disrupts the item neighborhoods required for preference propagation, resulting in a Preference Adaptation Gap. To address these challenges, we propose Calibrated Imputation for Incomplete Multimodal Recommendation (CaIRec), a two-stage framework. Structural Imputation Calibration (SIC) estimates missing-modality representations from shared information inferred from available modalities and calibrates their cross-modal organization through structural regularization and correspondence supervision from observed modality pairs. Preference-oriented Representation Calibration (PRC) performs recommendation-specific adaptation at both the representation and relation levels. It constructs pseudo-missing instances to align recovered representations with observed counterparts shaped by ranking supervision in the recommendation space. It further builds completion-aware item graphs by integrating completed content relations with collaborative evidence. Extensive experiments on three datasets under different modality-missing settings demonstrate the effectiveness and robustness of CaIRec.

多模态推荐模态补全结构校准推荐系统

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。