arXiv:2607.10909cs.IR2026-07中稿 · ACM MM2026被引 2

让大模型更好适配推荐系统,通过记忆保留与选择性更新提升性能

Stream-aware Side Adaptation for Large Pre-trained Multimodal Embedding Models in Sequential Recommendation

论文配图:Stream-aware Side Adaptation for Large Pre-trained Multimodal Embedding Models in Sequential Recommendation
图 1 · 摘自论文原文
  • 设计可保留历史信息的融合机制,避免深层适配时信号丢失
  • 在多个数据集上超越主流基线,不同大模型均表现稳定提升
  • 适合想高效利用预训练多模态大模型做推荐的工程师和研究者

近期,像Qwen3-VL Embedding这样的大型预训练多模态嵌入模型在序列推荐中展现出巨大潜力,因其能跨模态和领域复用语义物品表示。然而,直接使用这些嵌入常因领域错位导致性能不佳。高效侧边适配成为理想解决方案。尽管适配全部主干层理论上更有利,但现有侧边适配器随深度增加性能下降,导致不得不丢弃部分层,从而损失有用隐藏状态。这主要源于两个挑战:(1) 残差相加过程中缺乏对融合表示的选择建模;(2) 逐步Sigmoid融合时早期表示保留不足。本文提出一个实际问题:如何设计一种侧边适配方法,充分释放大型预训练多模态嵌入模型的潜力?为此,我们提出Stresa框架,专为冻结的大规模预训练多模态嵌入模型设计,引入流感知隐式适配融合(SHAF)以在融合中保持历史侧边记忆,并设计残差流适配器(ReSA)实现跨层的选择性残差更新。实验表明,Stresa在多个公开数据集上持续优于标准侧边适配器和最先进基线,适用于多种主干嵌入模型。结果验证了适配大模型在序列推荐中的前景。代码已开源:https://github.com/GAIR-Lab/Stresa。

原文摘要 · Abstract (English)

Recently, large pretrained multimodal embedding models such as Qwen3-VL Embedding have shown strong promise for sequential recommendation, as they provide reusable semantic item representations across modalities and domains. However, directly using these embeddings often leads to suboptimal performance because of domain misalignment. Efficient side adaptation is therefore an attractive solution. Although adapting all backbone layers should help, existing side adapters often degrade with depth, prompting layer dropping despite the loss of useful hidden states. This is due to two major challenges: (1) the lack of modeling in selecting fused representations during residual addition, and (2) the insufficient preservation of earlier representations during progressive sigmoid fusion. This paper therefore asks a practical question: How can we design a side adaptation approach that effectively unlocks the potential of large pre-trained multimodal embedding models? To address this question, we propose Stresa, a stream-aware side-adaptation framework for frozen large pre-trained multimodal embedding models in sequential recommendation. Stresa introduces Stream-aware Hidden-Adapter Fusion (SHAF) to preserve historical side memory during fusion and Residual Stream Adapter (ReSA) to produce selective residual updates across layers. Empirically, Stresa consistently outperforms standard side adapters and state-of-the-art baselines on public datasets across multiple backbone embedding models. These results highlight the promise of adapting large embedding models for sequential recommendation. Our code is publicly available at https://github.com/GAIR-Lab/Stresa.

序列推荐多模态嵌入侧边适配大模型应用

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。