通过投影消除多模态推荐中的冗余信息,提升模型表现
CLEAR: Null-Space Projection for Cross-Modal De-Redundancy in Multimodal Recommendation
- 用协方差分析识别跨模态共享冗余空间,通过奇异值分解定位主方向
- 将特征投影到补空间,抑制冗余成分,保留模态特异性信息
- 轻量级插件设计,可无缝接入现有模型,无需改架构或训练目标
多模态推荐通过融合视觉、文本等异构内容提升协同过滤效果。然而现有方法过度强调跨模态一致性,导致多模态表示存在显著冗余,主导共享成分在不同模态间重叠,限制了互补信息的有效利用,解释了为何增加模态未必提升性能。本文提出CLEAR,一种轻量级、可即插即用的跨模态去冗余方法。它通过建模视觉与文本表征间的跨模态协方差,识别冗余共享子空间;利用奇异值分解提取主共享方向,并将多模态特征投影至互补零空间,从而重塑表示空间,抑制冗余成分同时保留模态特异性信息。该子空间级投影隐式调控表示学习过程,防止训练中重复放大冗余语义。实验表明,CLEAR可无缝集成至多种主流多模态推荐模型,在三个公开数据集上均显著提升性能。
原文摘要 · Abstract (English)
Multimodal recommendation has emerged as an effective paradigm for enhancing collaborative filtering by incorporating heterogeneous content modalities. Existing multimodal recommenders predominantly focus on reinforcing cross-modal consistency to facilitate multimodal fusion. However, we observe that multimodal representations often exhibit substantial cross-modal redundancy, where dominant shared components overlap across modalities. Such redundancy can limit the effective utilization of complementary information, explaining why incorporating additional modalities does not always yield performance improvements. In this work, we propose CLEAR, a lightweight and plug-and-play cross-modal de-redundancy approach for multimodal recommendation. Rather than enforcing stronger cross-modal alignment, CLEAR explicitly characterizes the redundant shared subspace across modalities by modeling cross-modal covariance between visual and textual representations. By identifying dominant shared directions via singular value decomposition and projecting multimodal features onto the complementary null space, CLEAR reshapes the multimodal representation space by suppressing redundant cross-modal components while preserving modality-specific information. This subspace-level projection implicitly regulates representation learning dynamics, preventing the model from repeatedly amplifying redundant shared semantics during training. Notably, CLEAR can be seamlessly integrated into existing multimodal recommenders without modifying their architectures or training objectives. Extensive experiments on three public benchmark datasets demonstrate that explicitly reducing cross-modal redundancy consistently improves recommendation performance across a wide range of multimodal recommendation models.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。