arXiv:2512.01372cs.IRcs.AI2025-12NeurIPS被引 9

通过分频域结构推理,提升多模态推荐在稀疏场景下的稳定性与准确性。

Structured Spectral Reasoning for Frequency-Adaptive Multimodal Recommendation

  • 分频域分解+掩码机制,动态识别并抑制噪声频率成分。
  • 在三个真实数据集上优于主流基线,冷启动场景下提升显著。
  • 适合关注多模态推荐鲁棒性与可解释性的研究者使用。

多模态推荐旨在融合协同信号与视觉、文本等异构内容,但面临模态特异性噪声、语义不一致及用户-物品图中传播不稳定等问题。现有方法多采用静态滤波或浅层建模,难以适应模态可靠性差异。为此,本文提出结构化谱推理(SSR)框架,包含四阶段:(i) 通过图引导变换将多模态信号分解为谱带,分离语义粒度;(ii) 利用训练时的谱带掩码与一致性预测目标,调制各频带可靠性,抑制脆弱频率成分;(iii) 采用低秩跨频带交互进行超光谱推理,融合互补频率线索;(iv) 通过对比正则化对齐模态特定谱特征,增强语义与结构一致性。在三个真实世界基准测试中,模型持续优于强基线,尤其在稀疏与冷启动设置下表现突出。额外分析表明,该结构化谱建模提升了鲁棒性,并能清晰诊断各频带对性能的贡献。

原文摘要 · Abstract (English)

Multimodal recommendation aims to integrate collaborative signals with heterogeneous content such as visual and textual information, but remains challenged by modality-specific noise, semantic inconsistency, and unstable propagation over user-item graphs. These issues are often exacerbated by naive fusion or shallow modeling strategies, leading to degraded generalization and poor robustness. While recent work has explored the frequency domain as a lens to separate stable from noisy signals, most methods rely on static filtering or reweighting, lacking the ability to reason over spectral structure or adapt to modality-specific reliability. To address these challenges, we propose a Structured Spectral Reasoning (SSR) framework for frequency-aware multimodal recommendation. Our method follows a four-stage pipeline: (i) Decompose graph-based multimodal signals into spectral bands via graph-guided transformations to isolate semantic granularity; (ii) Modulate band-level reliability with spectral band masking, a training-time masking with a prediction-consistency objective that suppresses brittle frequency components; (iii) Fuse complementary frequency cues using hyperspectral reasoning with low-rank cross-band interaction; and (iv) Align modality-specific spectral features via contrastive regularization to promote semantic and structural consistency. Experiments on three real-world benchmarks show consistent gains over strong baselines, particularly under sparse and cold-start settings. Additional analyses indicate that structured spectral modeling improves robustness and provides clearer diagnostics of how different bands contribute to performance.

多模态推荐谱推理冷启动图神经网络

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。