arXiv:2608.23131cs.IR2026-08中稿 · CIKM 2026

用双专家机制让大模型更好跨域推荐,避免错误知识干扰。

A Dual-Expert Strategy Integrating LLMs to Mitigate Negative Transfer in Cross-Domain Sequential Recommendation

论文配图:A Dual-Expert Strategy Integrating LLMs to Mitigate Negative Transfer in Cross-Domain Sequential Recommendation
图 1 · 摘自论文原文
  • 设计双专家结构,分别处理单域和跨域推荐,减少噪声干扰。
  • 通过对比学习让模型捕捉物品级协同信号,提升推荐准确性。
  • 在十个真实领域上超越26种前沿方法,适合跨域推荐场景。

跨域序列推荐(CDSR)基于用户在多个领域的历史交互序列预测其下一个交互项目。近期方法利用微调后的大型语言模型(LLMs)对跨域用户序列的文本表示进行检索以推荐项目,称为LLMRec。然而,LLMRec主要建模项文本的自回归模式,忽略了物品级协同信号,导致语义错位,引发负迁移,降低推荐性能。为此,我们提出新模型DuELRec:基于大模型的域门控双专家跨域序列推荐。该模型采用域门控双专家框架,配备物品感知注意力变换模块,将文本子标记聚合为物品级表示,并施加块级注意力掩码。单域专家仅允许同域自回归注意力,跨域专家则允许跨所有域。门控机制自适应融合输出,利用单域信号抑制跨域噪声。其次,引入双采样词到物品对比学习目标,使模型从单域和跨域中捕捉物品级协同信号。通过将词级物品文本转换为物品级表示,并从单域和跨域物品池中进行随机负采样实现对比学习。在两个真实世界数据集上的十域实验表明,本模型优于26种前沿方法。

原文摘要 · Abstract (English)

Cross-Domain Sequential Recommendation (CDSR) predicts the next item a user will interact with based on their historical interaction sequences across multiple domains. Recent approaches leverage Large Language Models (LLMs) finetuned on textual representations of cross-domain user sequences to retrieve the recommended items, referred to as LLMRec. However, LLMRec primarily models the autoregressive patterns of token-level item texts, while overlooking item-level collaborative signals. This semantic misalignment often leads to distorted knowledge transfer across domains-termed negative transfer degrading performance in the CDSR task. To address this issue, we propose a novel LLM-based CDSR model, DuELRec: Domain-Gated Dual Experts with LLMs for Cross-Domain Sequential Recommendation. We propose a domain-gated dual-expert framework, equipped with an item-aware attention transformation module, which aggregates textual subtokens into item-level representations and enforces block-level attention masking. The single-domain expert restricts autoregressive attention to items within the same domain, while the cross-domain expert allows it across all domains. A gating mechanism adaptively fuses their outputs, using single-domain signals to reduce cross-domain noise that causes negative transfer. Second, we introduce a dual-sampling token-to-item contrastive learning objective that allows LLMs to capture the item-level collaborative signals from both single- and cross-domains. This is achieved by transforming token-level item texts into item-level representations and applying stochastic negative sampling from both single- and cross-domain item pools for contrastive learning. Extensive experiments on two real-world datasets across ten domains show that our model outperforms 26 state-of-the-art methods in recommendation performance.

跨域推荐大模型双专家对比学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。