提出新模型MMM4Rec,让多模态推荐更快更准地迁移。
Towards Transfer-Efficient Multi-modal Sequential Recommendation with State Space Duality
- 用状态空间对偶机制动态抓取关键模态信息
- 在大规模数据上实现10倍加速的快速微调收敛
- 适合需要高效跨场景推荐的工业应用
序列推荐模型通过用户行为历史推断偏好。尽管可迁移的多模态方法优于传统基于ID的方案,但现有方法因复杂的优化需求和负迁移效应导致微调收敛缓慢。我们提出MMM4Rec(多模态Mamba用于序列推荐),一种新型多模态序列推荐框架,引入专用代数约束机制以实现高效迁移学习。结合状态空间对偶(SSD)的时间衰减特性与全局感知的时间建模设计,模型能动态优先处理关键模态信息,克服Transformer方法的局限。该框架采用受约束的两阶段流程:(1) 通过共享投影矩阵实现序列级跨模态对齐;(2) 使用新设计的跨SSD模块和双通道傅里叶自适应滤波进行时间融合。此架构在保持语义一致性的同时抑制噪声传播。通过引入与序列推荐先验一致的代数结构约束,MMM4Rec在预训练与微调中均采用简单一致的交叉熵目标,实现快速微调收敛,显著提升多模态推荐准确率并保留强迁移能力。大量实验表明,该模型达到当前最优性能,在多模态检索中表现优异,并在迁移到大规模下游数据集时平均收敛速度提升10倍。代码已开源:https://github.com/AlwaysFHao/MMM4Rec。
原文摘要 · Abstract (English)
Sequential Recommendation (SR) models infer user preferences from interaction histories. While transferable Multi-modal SR models outperform traditional ID-based approaches, existing methods struggle with slow fine-tuning convergence due to complex optimization requirements and negative transfer effects. We propose MMM4Rec (Multi-Modal Mamba for Sequential Recommendation), a novel Multi-modal SR framework that incorporates a dedicated algebraic constraint mechanism for efficient transfer learning. By combining State Space Duality (SSD)'s temporal decay properties with a globally-aware temporal modeling design, our model dynamically prioritizes key modality information, overcoming limitations of Transformer-based approaches. The framework implements a constrained two-stage process: (1) sequence-level cross-modal alignment via shared projection matrices, followed by (2) temporal fusion using our newly designed Cross-SSD module and dual-channel Fourier adaptive filtering. This architecture maintains semantic consistency while suppressing noise propagation. By incorporating algebraic structural constraints aligned with SR priors, MMM4Rec employs a simple and consistent cross-entropy objective across both pre-training and fine-tuning, enabling rapid fine-tuning convergence, substantially improving multimodal recommendation accuracy, and preserving strong transferability. Extensive experiments demonstrate MMM4Rec's state-of-the-art performance, achieving strong multi-modal retrieval capability and exhibiting 10$\times$ faster average convergence speed when transferring to large-scale downstream datasets. The implementation is available at link https://github.com/AlwaysFHao/MMM4Rec.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。