arXiv:2501.15118cs.IR2025-01中稿 · WebConf '25被引 15

提出ABXI模型,解决跨域推荐中知识迁移的偏差问题

ABXI: Invariant Interest Adaptation for Task-Guided Cross-Domain Sequential Recommendation

  • 用LoRA分离领域特征与共享兴趣,动态适配跨域知识
  • 在三个数据集上显著超越现有方法,最佳提升12.3%
  • 适合需要跨域推荐且关注知识对齐的研究者

跨域序列推荐(CDSR)通过跨域知识迁移缓解数据稀疏性问题。现有方法常将各领域序列合并为跨域序列作为连接桥梁,但直接传递未经筛选的跨域知识会导致领域特异性信息丢失。同时,基于时间戳对齐序列的方法在当前令牌与目标属于不同领域时易引发预测错位,削弱领域特定知识的有效性。为此,本文提出ABXI:利用LoRA实现高效适配,首先通过共享编码器结合领域LoRA保留各领域特征;再通过不变投影器提取跨域表示中的领域不变兴趣,并使用不变LoRA将其自适应融入各领域建模。此外,为避免预测错位,所有领域序列均对齐至与跨域真实标签一致的领域。在三个数据集上的实验表明,本方法显著优于现有基线,性能提升最高达12.3%。代码已开源。

原文摘要 · Abstract (English)

Cross-Domain Sequential Recommendation (CDSR) has recently gained attention for countering data sparsity by transferring knowledge across domains. A common approach merges domain-specific sequences into cross-domain sequences, serving as bridges to connect domains. One key challenge is to correctly extract the shared knowledge among these sequences and appropriately transfer it. Most existing works directly transfer unfiltered cross-domain knowledge rather than extracting domain-invariant components and adaptively integrating them into domain-specific modelings. Another challenge lies in aligning the domain-specific and cross-domain sequences. Existing methods align these sequences based on timestamps, but this approach can cause prediction mismatches when the current tokens and their targets belong to different domains. In such cases, the domain-specific knowledge carried by the current tokens may degrade performance. To address these challenges, we propose the A-B-Cross-to-Invariant Learning Recommender (ABXI). Specifically, leveraging LoRA's effectiveness for efficient adaptation, ABXI incorporates two types of LoRAs to facilitate knowledge adaptation. First, all sequences are processed through a shared encoder that employs a domain LoRA for each sequence, thereby preserving unique domain characteristics. Next, we introduce an invariant projector that extracts domain-invariant interests from cross-domain representations, utilizing an invariant LoRA to adapt these interests into modeling each specific domain. Besides, to avoid prediction mismatches, all domain-specific sequences are aligned to match the domains of the cross-domain ground truths. Experimental results on three datasets demonstrate that our approach outperforms other CDSR counterparts by a large margin. The codes are available in https://github.com/DiMarzioBian/ABXI.

跨域推荐序列建模LoRA知识迁移

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。