arXiv:2504.04843cs.IR2025-04中稿 · SIGIR 2025 Full Pa…被引 28

测试时数据增强让推荐模型更准,且无需重新训练。

Data Augmentation as Free Lunch: Exploring the Test-Time Augmentation for Sequential Recommendation

  • 在推理阶段对输入做增强,聚合预测结果提升准确率。
  • 掩码和替换操作在测试时表现最好,保持序列模式同时引入扰动。
  • 提出TNoise和TMask,避免选品耗时与掩码干扰,效率更高。

数据增强能有效缓解序列推荐中的数据稀疏问题。现有方法在训练阶段生成新数据以提升性能,但需重新训练、修改架构或引入可学习参数,对大型模型代价高昂。本文探索测试时增强(TTA)在序列推荐中的应用:在模型推理时对输入进行增强,并聚合增强数据的预测结果以提高最终精度,避免损失计算和反向传播的开销。实验发现,掩码(Mask)和替换(Substitute)操作在测试时具有潜力,因其在保留原始序列模式的同时引入适当扰动。但二者仍存在选品耗时或掩码词干扰的问题。基于此,提出TNoise(在原表示中注入均匀噪声,避免选品开销)和TMask(阻止掩码项参与计算或直接移除应被替换的交互)。大量实验证明该方法有效、高效且具备泛化能力。代码已开源:https://github.com/KingGugu/TTA4SR。

原文摘要 · Abstract (English)

Data augmentation has become a promising method of mitigating data sparsity in sequential recommendation. Existing methods generate new yet effective data during model training to improve performance. However, deploying them requires retraining, architecture modification, or introducing additional learnable parameters. The above steps are time-consuming and costly for well-trained models, especially when the model scale becomes large. In this work, we explore the test-time augmentation (TTA) for sequential recommendation, which augments the inputs during the model inference and then aggregates the model's predictions for augmented data to improve final accuracy. It avoids significant time and cost overhead from loss calculation and backward propagation. We first experimentally disclose the potential of existing augmentation operators for TTA and find that the Mask and Substitute consistently achieve better performance. Further analysis reveals that these two operators are effective because they retain the original sequential pattern while adding appropriate perturbations. Meanwhile, we argue that these two operators still face time-consuming item selection or interference information from mask tokens. Based on the analysis and limitations, we present TNoise and TMask. The former injects uniform noise into the original representation, avoiding the computational overhead of item selection. The latter blocks mask token from participating in model calculations or directly removes interactions that should have been replaced with mask tokens. Comprehensive experiments demonstrate the effectiveness, efficiency, and generalizability of our method. We provide an anonymous implementation at https://github.com/KingGugu/TTA4SR.

序列推荐测试时增强数据增强效率优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。