提出新框架提升推荐系统对时间分布变化的长期适应能力。
A Probabilistic Framework for Temporal Distribution Generalization in Industry-Scale Recommender Systems
- 基于因果图构建变分自监督目标,避免表征崩溃
- 通过重采样时间变化因素扩展训练数据分布,提升泛化能力
- 在真实电商场景中实现用户每单GMV提升2.33%,已落地应用
时间分布漂移会削弱推荐系统的长期准确性,而工业界仍依赖周期性增量训练,难以同时捕捉稳定与瞬时模式。现有方法如不变学习和自监督学习虽有部分成效,但常出现时间泛化不稳定、表征坍塌或数据利用效率低的问题。为此,我们提出ELBO$_\text{TDS}$,一个可无缝集成到工业级增量学习流程的概率框架。首先,通过分析真实生产数据识别关键漂移因子,并设计简单有效的数据增强策略,重采样这些时变因子以扩展训练支持范围。其次,为充分利用扩展后的分布并防止表征坍塌,基于因果图建模时间推荐场景,推导出基于因果结构的自监督变分目标ELBO$_\text{TDS}$。理论与实证分析表明,该方法显著提升时间泛化性能,在用户层面带来2.33%的GMV增长,已在Shopee Product Search成功部署。代码见https://github.com/FuCongResearchSquad/ELBO4TDS。
原文摘要 · Abstract (English)
Temporal distribution shift (TDS) erodes the long-term accuracy of recommender systems, yet industrial practice still relies on periodic incremental training, which struggles to capture both stable and transient patterns. Existing approaches such as invariant learning and self-supervised learning offer partial solutions but often suffer from unstable temporal generalization, representation collapse, or inefficient data utilization. To address these limitations, we propose ELBO$_\text{TDS}$, a probabilistic framework that integrates seamlessly into industry-scale incremental learning pipelines. First, we identify key shifting factors through statistical analysis of real-world production data and design a simple yet effective data augmentation strategy that resamples these time-varying factors to extend the training support. Second, to harness the benefits of this extended distribution while preventing representation collapse, we model the temporal recommendation scenario using a causal graph and derive a self-supervised variational objective, ELBO$_\text{TDS}$, grounded in the causal structure. Extensive experiments supported by both theoretical and empirical analysis demonstrate that our method achieves superior temporal generalization, yielding a 2.33\% uplift in GMV per user and has been successfully deployed in Shopee Product Search. Code is available at https://github.com/FuCongResearchSquad/ELBO4TDS.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。