arXiv:2508.06450cs.IRcs.LG2025-08中稿 · ACM RecSys 2025被引 5

通过模块化组合提升Transformer推荐模型性能,效果优于现有主流方法。

eSASRec: Enhancing Transformer-based Recommendations in a Modular Fashion

  • 将SASRec训练目标、LiGR结构和采样Softmax损失组合成新模型
  • 在真实场景评估中达到准确率与覆盖率的最优平衡
  • 改动简单无需额外特征,适合直接接入工业推荐系统

自引入以来,基于Transformer的模型如SASRec和BERT4Rec已成为序列推荐的通用基线,超越了早期神经与非神经方法。后续研究通过微调Transformer结构、优化训练目标或改进损失函数等方式提升了模型效果。然而,这些模块化改进的叠加效应尚未系统评估。本文通过实验发现,结合SASRec训练目标、LiGR Transformer层与采样Softmax损失的模型表现强劲,命名为eSASRec(Enhanced SASRec)。尽管主要聚焦于类生产环境评估,在初步学术基准测试中,eSASRec相较最新SOTA模型ActionPiece提升23%。在主生产类基准中,eSASRec位于准确率-覆盖率帕累托前沿,与近期工业模型HSTU和FuXi并列。相较于原始SASRec的改动较小,且无需额外特征(如时间戳),可轻松集成至现有推荐系统。为此,我们开源了模型与评估代码(https://github.com/blondered/transformer_benchmark)。

原文摘要 · Abstract (English)

Since their introduction, Transformer-based models, such as SASRec and BERT4Rec, have become common baselines for sequential recommendations, surpassing earlier neural and non-neural methods. A number of following publications have shown that the effectiveness of these models can be improved by, for example, slightly updating the architecture of the Transformer layers, using better training objectives, and employing improved loss functions. However, the additivity of these modular improvements has not been systematically benchmarked - this is the gap we aim to close in this paper. Through our experiments, we identify a very strong model that uses SASRec's training objective, LiGR Transformer layers, and Sampled Softmax Loss. We call this combination eSASRec (Enhanced SASRec). While we primarily focus on realistic, production-like evaluation, in our preliminarily study we find that common academic benchmarks show eSASRec to be 23% more effective compared to the most recent state-of-the-art models, such as ActionPiece. In our main production-like benchmark, eSASRec resides on the Pareto frontier in terms of the accuracy-coverage tradeoff (alongside the recent industrial models HSTU and FuXi. As the modifications compared to the original SASRec are relatively straightforward and no extra features are needed (such as timestamps in HSTU), we believe that eSASRec can be easily integrated into existing recommendation pipelines and can can serve as a strong yet very simple baseline for emerging complicated algorithms. To facilitate this, we provide the open-source implementations for our models and benchmarks in repository https://github.com/blondered/transformer_benchmark

推荐系统Transformer模块化改进工业落地

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。