无需共享用户数据,通过模型合并实现跨领域推荐
MergeRec: Model Merging for Data-Isolated Cross-Domain Sequential Recommendation
- 用无训练的模型合并初始化,避免数据共享
- 构造虚拟用户序列生成训练样本,提升跨域泛化能力
- 适合隐私敏感场景,可扩展至多领域推荐系统
当前推荐系统在单一领域表现良好,但跨领域泛化能力差。现有方法依赖重叠用户或物品,或忽视隐私约束。本文提出新框架MergeRec,解决数据隔离下的跨域序列推荐问题。该框架包含三部分:(1)无训练模型合并初始化;(2)将每个物品视为虚拟序列,构建伪用户数据以合成训练样本;(3)联合优化目标,结合推荐损失与知识蒸馏损失,迁移源模型协同过滤信号。实验表明,相比传统方法,MergeRec在Recall@10上平均提升最高达17.21%,既保留原模型优势,又显著增强对未见领域的泛化能力。代码已开源。
原文摘要 · Abstract (English)
Modern recommender systems trained on domain-specific data often struggle to generalize across multiple domains. Cross-domain sequential recommendation has emerged as a promising research direction to address this challenge; however, existing approaches face fundamental limitations, such as reliance on overlapping users or items across domains, or unrealistic assumptions that ignore privacy constraints. In this work, we propose a new framework, MergeRec, based on model merging under a new and realistic problem setting termed data-isolated cross-domain sequential recommendation, where raw user interaction data cannot be shared across domains. MergeRec consists of three key components: (1) merging initialization, (2) pseudo-user data construction, and (3) collaborative merging optimization. First, we initialize a merged model using training-free merging techniques. Next, we construct pseudo-user data by treating each item as a virtual sequence in each domain, enabling the synthesis of meaningful training samples without relying on real user interactions. Finally, we optimize domain-specific merging weights through a joint objective that combines a recommendation loss, which encourages the merged model to identify relevant items, and a distillation loss, which transfers collaborative filtering signals from the fine-tuned source models. Extensive experiments demonstrate that MergeRec not only preserves the strengths of the original models but also significantly enhances generalizability to unseen domains. Compared to conventional model merging methods, MergeRec consistently achieves superior performance, with average improvements of up to 17.21% in Recall@10, highlighting the potential of model merging as a scalable and effective approach for building universal recommender systems. The source code is available at https://github.com/DIALLab-SKKU/MergeRec.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。