将用户历史行为压缩为紧凑嵌入,提升推荐系统长序列建模效果
IAT: Instance-As-Token Compression for Historical User Sequence Modeling in Industrial Recommender Systems
- 把每个交互实例压缩成统一嵌入,保留时序与用户顺序信息
- 在电商、直播等场景中显著提升点击率和转化率
- 适合工业级推荐系统,尤其擅长跨域迁移
尽管先进的序列建模方法在推荐系统中已取得显著成效,但手工设计的序列特征信息容量限制了性能上限。本文提出一种名为实例即令牌(Instance-As-Token, IAT)的两阶段序列建模框架,以更有效地编码用户历史交互模式。第一阶段将每个历史交互实例的所有特征压缩为统一的实例嵌入,形成紧凑且信息丰富的令牌,同时提出时间顺序与用户顺序两种压缩策略,后者更契合下游序列建模需求。第二阶段通过时间戳获取固定长度的压缩实例令牌,并采用标准序列建模方法学习长程偏好模式。大量实验表明,IAT 显著优于现有最先进方法,在域内与跨域场景下均表现出优越的可迁移性。该方法已在真实工业推荐系统中成功部署,涵盖电商广告、购物中心营销及直播电商,显著提升了关键业务指标。
原文摘要 · Abstract (English)
Although sophisticated sequence modeling paradigms have achieved remarkable success in recommender systems, the information capacity of hand-crafted sequential features constrains the performance upper bound. To better enhance user experience by encoding historical interaction patterns, this paper presents a novel two-stage sequence modeling framework termed Instance-As-Token (IAT). The first stage of IAT compresses all features of each historical interaction instance into a unified instance embedding, which encodes the interaction characteristics in a compact yet informative token. Both temporal-order and user-order compression schemes are proposed, with the latter better aligning with the demands of downstream sequence modeling. The second stage involves the downstream task fetching fixed-length compressed instance tokens via timestamps and adopting standard sequence modeling approaches to learn long-range preferences patterns. Extensive experiments demonstrate that IAT significantly outperforms state-of-the-art methods and exhibits superior in-domain and cross-domain transferability. IAT has been successfully deployed in real-world industrial recommender systems, including e-commerce advertising, shopping mall marketing, and live-streaming e-commerce, delivering substantial improvements in key business metrics.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。