arXiv:2505.04445cs.IR2025-05被引 10

用多尺度Mamba+傅里叶分析,提升推荐系统效率与准确性

M2Rec: Multi-scale Mamba for Efficient Sequential Recommendation

  • 引入FFT在频域显式建模周期行为,分离趋势与噪声
  • 结合LLM文本嵌入,增强稀疏交互的语义信息
  • 自适应门控融合时序、频率与语义特征,适合多模态场景

序列推荐系统基于用户交互历史预测其下一偏好,但现有方法在效率和多尺度模式识别上存在瓶颈。尽管基于Transformer的方法计算复杂度高,近期基于Mamba的模型虽提升了效率,却难以捕捉周期性用户行为、利用丰富语义信息或有效融合多模态特征。为此,我们提出M2Rec,一种新型序列推荐框架,集成多尺度Mamba、傅里叶分析、大语言模型(LLMs)与自适应门控机制。首先,通过快速傅里叶变换(FFT)增强Mamba,在频域显式建模周期模式,分离有意义的趋势与噪声。其次,引入基于LLM的文本嵌入,从商品描述中提取语义信息以丰富稀疏交互数据。最后,设计可学习门控机制,动态平衡时序(Mamba)、频率(FFT)与语义(LLM)特征,实现和谐多模态融合。大量实验表明,该模型在Hit Rate@10上比现有Mamba基线提升3.2%,推理速度比Transformer基线快20%。结果验证了频率分析、语义理解与自适应融合的协同有效性。代码与数据集见:https://anonymous.4open.science/r/M2Rec。

原文摘要 · Abstract (English)

Sequential recommendation systems aim to predict users' next preferences based on their interaction histories, but existing approaches face critical limitations in efficiency and multi-scale pattern recognition. While Transformer-based methods struggle with quadratic computational complexity, recent Mamba-based models improve efficiency but fail to capture periodic user behaviors, leverage rich semantic information, or effectively fuse multimodal features. To address these challenges, we propose \model, a novel sequential recommendation framework that integrates multi-scale Mamba with Fourier analysis, Large Language Models (LLMs), and adaptive gating. First, we enhance Mamba with Fast Fourier Transform (FFT) to explicitly model periodic patterns in the frequency domain, separating meaningful trends from noise. Second, we incorporate LLM-based text embeddings to enrich sparse interaction data with semantic context from item descriptions. Finally, we introduce a learnable gate mechanism to dynamically balance temporal (Mamba), frequency (FFT), and semantic (LLM) features, ensuring harmonious multimodal fusion. Extensive experiments demonstrate that \model\ achieves state-of-the-art performance, improving Hit Rate@10 by 3.2\% over existing Mamba-based models while maintaining 20\% faster inference than Transformer baselines. Our results highlight the effectiveness of combining frequency analysis, semantic understanding, and adaptive fusion for sequential recommendation. Code and datasets are available at: https://anonymous.4open.science/r/M2Rec.

序列推荐Mamba多模态融合傅里叶分析

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。