用序列自编码学习通用用户表示,提升推荐系统泛化能力
Encode Me If You Can: Learning Universal User Representations via Event Sequence Autoencoding
- 将用户行为序列输入GRU自编码器,从固定长度向量重建历史
- 在多个下游任务上实现良好泛化,团队获RecSys挑战赛第二名
- 融合多种嵌入方法生成统一表示,适合需要通用用户建模的场景
构建能捕捉用户行为核心特征的通用用户表示是现代机器学习系统的关键任务。真实应用场景中,用户的历史交互常用于解决包括流失预测、推荐和生命周期价值估计在内的多种预测任务。使用跨任务有效的任务无关用户表示,可减少特定任务的特征工程和模型重训练,提升机器学习流程的可扩展性和效率。2025年Synerise举办的RecSys挑战赛旨在从包含购买、浏览、搜索等多种事件的日志中构建此类通用行为画像。本文提出一种方法:将用户完整交互历史转化为时间序列,采用基于GRU的自编码器从固定大小的隐向量重建该序列。若模型能准确重建,该隐向量即被认为捕捉了关键行为模式。除核心模型外,还探索多种嵌入生成方式,并通过拼接输出向量构建统一表示。该集成策略进一步提升了在多样化下游任务上的泛化性能,助力团队ai_lab_recsys在比赛中获得第二名。
原文摘要 · Abstract (English)
Building universal user representations that capture the essential aspects of user behavior is a crucial task for modern machine learning systems. In real-world applications, a user's historical interactions often serve as the foundation for solving a wide range of predictive tasks, such as churn prediction, recommendations, or lifetime value estimation. Using a task-independent user representation that is effective across all such tasks can reduce the need for task-specific feature engineering and model retraining, leading to more scalable and efficient machine learning pipelines. The goal of the RecSys Challenge 2025 by Synerise was to develop such Universal Behavioral Profiles from logs of past user behavior, which included various types of events such as product purchases, page views, and search queries. We propose a method that transforms the entire user interaction history into a single chronological sequence and trains a GRU-based autoencoder to reconstruct this sequence from a fixed-size vector. If the model can accurately reconstruct the sequence, the latent vector is expected to capture the key behavioral patterns. In addition to this core model, we explored several alternative methods for generating user embeddings and combined them by concatenating their output vectors into a unified representation. This ensemble strategy further improved generalization across diverse downstream tasks and helped our team, ai_lab_recsys, achieve second place in the RecSys Challenge 2025.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。