解决多模态推荐中的语义冲突问题,提升推荐系统鲁棒性。
Beyond Modality Harmony: Orthogonal Purification and Topology-Guided MoE for Conflict-Aware Multimodal Recommendation

- 通过几何解耦将多模态特征分离为协同方向与噪声方向
- 在三个亚马逊数据集上优于主流基线,噪声下表现更稳定
- 适合处理带虚假内容或信息不一致的多模态推荐场景
多模态推荐系统通常依赖于‘模态和谐’假设,认为多模态特征天然有益且严格契合用户协同行为。然而,真实场景中普遍存在模态拓扑冲突,如欺骗性视觉点击诱饵和语义错配。盲目融合这些噪声模态会污染纯净的协同空间,导致严重表征失真。为此,我们提出冲突感知的多模态推荐框架 OrthoRec。核心是协同引导的正交净化(CGOP),通过几何方式将多模态特征分解为与纯协同锚点平行和正交的方向,并采用能量保持归一化自适应截断正交噪声,修正误导语义方向的同时保留模态内在表达能力。此外,设计拓扑感知路由专家混合(TAR-MoE),基于协同拓扑使用解耦sigmoid门控,打破传统softmax注意力的零和瓶颈,自主确定每种净化后模态的注入比例。最后引入安全自监督目标,动态惩罚矛盾样本的强制对比对齐。在三个真实世界Amazon数据集上的实验表明,OrthoRec持续优于近期先进基线,在模态噪声和物品稀疏条件下表现出更强鲁棒性。
原文摘要 · Abstract (English)
Multimodal Recommender Systems (MRSs) typically rely on a flawed "modality harmony" assumption, presuming that multimodal features are inherently beneficial and strictly aligned with users' collaborative interaction patterns. However, modality-topology conflicts are ubiquitous in real-world scenarios due to deceptive visual clickbaits and mismatched semantics. Blindly integrating these noisy modalities inevitably pollutes the pristine collaborative space, causing severe representation distortion. To address this, we propose Orthogonal purification and topology-guided MoE for conflict-aware multimodal Recommendation (OrthoRec). At its core, OrthoRec introduces Collaborative-Guided Orthogonal Purification (CGOP), which geometrically decouples multimodal features into directions parallel and orthogonal to a pure collaborative anchor. By adaptively truncating the orthogonal noise with an energy-preserving normalization, CGOP rectifies deceptive semantic directions while preserving the modality's intrinsic representation capacity. Furthermore, we design a Topology-Aware Routing Mixture-of-Experts (TAR-MoE). Guided by the collaborative topology, TAR-MoE employs decoupled sigmoid gating to break the zero-sum bottleneck of traditional softmax attention, autonomously determining the injection scale for each purified modality. Finally, a safe-SSL objective is introduced to dynamically penalize the forced contrastive alignment of contradictory pairs. Experiments on three real-world Amazon datasets show that OrthoRec consistently outperforms competitive recent baselines and exhibits improved robustness under modality noise and item sparsity.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。