解决零样本跨域推荐中的语义偏差问题,提升模型泛化能力。
LLM-RecG: A Semantic Bias-Aware Framework for Zero-Shot Sequential Recommendation
- 引入通用性损失,实现跨域物品嵌入对齐与域内多样性保持。
- 通过聚类和注意力聚合,动态迁移用户行为模式至新领域。
- 无需目标域数据,适用于冷启动场景的推荐系统设计。
零样本跨域序列推荐(ZCDSR)可在无额外训练或微调的情况下预测未见领域的用户偏好,克服传统模型在数据稀疏环境下的局限。尽管大语言模型(LLM)通过丰富的预训练表示显著提升了跨域知识迁移能力,但因不同领域间词汇与内容焦点差异导致的语义偏差仍持续影响模型表现,造成物品嵌入错位、泛化能力下降。为此,我们提出一种新型语义偏差感知框架,通过在物品与序列层面增强跨域对齐,改进基于LLM的ZCDSR。在物品层面,引入通用性损失,促进跨域嵌入紧凑性(inter-domain compactness),同时保留各域内物品的独特特征(intra-domain diversity),防止嵌入过度泛化。在序列层面,采用源域用户序列聚类,并在目标域推理中使用注意力聚合方法,动态适配用户嵌入至未见领域,实现无需目标域交互的零样本推荐。
原文摘要 · Abstract (English)
Zero-shot cross-domain sequential recommendation (ZCDSR) enables predictions in unseen domains without additional training or fine-tuning, addressing the limitations of traditional models in sparse data environments. Recent advancements in large language models (LLMs) have significantly enhanced ZCDSR by facilitating cross-domain knowledge transfer through rich, pretrained representations. Despite this progress, domain semantic bias -- arising from differences in vocabulary and content focus between domains -- remains a persistent challenge, leading to misaligned item embeddings and reduced generalization across domains. To address this, we propose a novel semantic bias-aware framework that enhances LLM-based ZCDSR by improving cross-domain alignment at both the item and sequential levels. At the item level, we introduce a generalization loss that aligns the embeddings of items across domains (inter-domain compactness), while preserving the unique characteristics of each item within its own domain (intra-domain diversity). This ensures that item embeddings can be transferred effectively between domains without collapsing into overly generic or uniform representations. At the sequential level, we develop a method to transfer user behavioral patterns by clustering source domain user sequences and applying attention-based aggregation during target domain inference. We dynamically adapt user embeddings to unseen domains, enabling effective zero-shot recommendations without requiring target-domain interactions...
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。