对比生成推荐与传统模型的泛化能力,发现二者各有所长。
How Well Does Generative Recommendation Generalize?
- 按预测所需能力分类数据:记忆或泛化
- 生成模型在泛化任务上表现更好,传统模型在记忆任务上更优
- 提出记忆感知融合机制,提升整体推荐效果
生成推荐(GR)模型通常被认为比基于物品ID的传统模型泛化能力更强,但这一假设缺乏系统验证。为此,我们根据预测所需能力将数据实例分为两类:记忆(复用训练中观察到的物品转移模式)和泛化(组合已知模式预测未见的物品转移)。大量实验表明,GR模型在需要泛化的任务上表现更佳,而基于物品ID的模型在记忆任务上更优。进一步分析发现,看似物品级的泛化实际多为分词级的记忆。最后,我们证明两种范式具有互补性,并提出一种简单的记忆感知指标,在实例层面自适应融合二者,显著提升整体推荐性能。
原文摘要 · Abstract (English)
A widely held hypothesis for why generative recommendation (GR) models outperform conventional item ID-based models is that they generalize better. However, there is few systematic way to verify this hypothesis beyond a superficial comparison of overall performance. To address this gap, we categorize each data instance based on the specific capability required for a correct prediction: either memorization (reusing item transition patterns observed during training) or generalization (composing known patterns to predict unseen item transitions). Extensive experiments show that GR models perform better on instances that require generalization, whereas item ID-based models perform better when memorization is more important. To explain this divergence, we shift the analysis from the item level to the token level and show that what appears to be item-level generalization often reduces to token-level memorization for GR models. Finally, we show that the two paradigms are complementary. We propose a simple memorization-aware indicator that adaptively combines them on a per-instance basis, leading to improved overall recommendation performance.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。