提出系统化生成推荐的数据增强框架,提升模型泛化与效率
Sequential Data Augmentation for Generative Recommendation
- 将数据增强建模为三步随机采样过程,可灵活控制训练分布
- 在多个数据集上实现更高准确率、更优数据与参数效率
- 适合需要高效训练生成式推荐模型的研究者与工程师
生成式推荐在个性化系统中至关重要,旨在从用户历史行为序列预测未来交互。然而,训练过程中数据增强——即从用户交互历史构建训练数据——这一关键却未被充分研究。现有方法常简化处理或随意应用,缺乏系统性理解。我们发现不同增强策略会导致显著性能差异,因此深入分析其如何重塑训练分布,并影响模型对未来的对齐能力及对未见输入的泛化能力。为此,我们提出GenPAS,一个统一且原则化的框架,将增强视为对输入-目标对的随机采样过程,包含序列采样、目标采样和输入采样三个可调控偏差的步骤。该形式涵盖多种常用策略作为特例,支持灵活控制训练分布。大量实验表明,GenPAS在基准与工业数据集上均优于现有方法,在准确率、数据效率与参数效率方面表现更优,为生成式推荐中的训练数据构造提供实用指导。代码已开源。
原文摘要 · Abstract (English)
Generative recommendation plays a crucial role in personalized systems, predicting users' future interactions from their historical behavior sequences. A critical yet underexplored factor in training these models is data augmentation, the process of constructing training data from user interaction histories. By shaping the training distribution, data augmentation directly and often substantially affects model generalization and performance. Nevertheless, in much of the existing work, this process is simplified, applied inconsistently, or treated as a minor design choice, without a systematic and principled understanding of its effects. Motivated by our empirical finding that different augmentation strategies can yield large performance disparities, we conduct an in-depth analysis of how they reshape training distributions and influence alignment with future targets and generalization to unseen inputs. To systematize this design space, we propose GenPAS, a generalized and principled framework that models augmentation as a stochastic sampling process over input-target pairs with three bias-controlled steps: sequence sampling, target sampling, and input sampling. This formulation unifies widely used strategies as special cases and enables flexible control of the resulting training distribution. Our extensive experiments on benchmark and industrial datasets demonstrate that GenPAS yields superior accuracy, data efficiency, and parameter efficiency compared to existing strategies, providing practical guidance for principled training data construction in generative recommendation. Our code is available at https://github.com/snap-research/GenPAS.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。