arXiv:2505.00953cs.IRcs.LG2025-05

用自监督方法提升用户行为序列建模,减少对大量负样本依赖。

Enhancing User Sequence Modeling through Barlow Twins-based Self-Supervised Learning

  • 基于Barlow Twins思想设计用户序列自监督学习框架
  • 在三个数据集上相比双编码器模型提升8%-20%准确率
  • 适合标签数据少、负样本难获取的推荐场景

用户序列建模对现代大规模推荐系统至关重要,可从用户历史交互中提取有价值的用户与物品表征,广泛应用于下游任务以优化用户体验。现有自监督学习方法常依赖大量负样本采样,计算开销大且难以在实际场景中应用。本文将前沿的Barlow Twins方法适配于用户序列建模,结合合适的数据增强策略,有效降低对大批次负样本的需求,可在小批量和少量标注数据下实现高效表征学习。我们在MovieLens-1M、MovieLens-20M和Yelp数据集上进行评估,结果表明该方法在三项下游任务中持续优于广泛使用的双编码器模型,准确率提升达8%-20%。研究验证了该方法在稀缺标注数据与有限负样本条件下挖掘序列级信息的有效性。

原文摘要 · Abstract (English)

User sequence modeling is crucial for modern large-scale recommendation systems, as it enables the extraction of informative representations of users and items from their historical interactions. These user representations are widely used for a variety of downstream tasks to enhance users' online experience. A key challenge for learning these representations is the lack of labeled training data. While self-supervised learning (SSL) methods have emerged as a promising solution for learning representations from unlabeled data, many existing approaches rely on extensive negative sampling, which can be computationally expensive and may not always be feasible in real-world scenario. In this work, we propose an adaptation of Barlow Twins, a state-of-the-art SSL methods, to user sequence modeling by incorporating suitable augmentation methods. Our approach aims to mitigate the need for large negative sample batches, enabling effective representation learning with smaller batch sizes and limited labeled data. We evaluate our method on the MovieLens-1M, MovieLens-20M, and Yelp datasets, demonstrating that our method consistently outperforms the widely-used dual encoder model across three downstream tasks, achieving an 8%-20% improvement in accuracy. Our findings underscore the effectiveness of our approach in extracting valuable sequence-level information for user modeling, particularly in scenarios where labeled data is scarce and negative examples are limited.

自监督学习推荐系统序列建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。