提出时间感知的持续学习框架,解决用户表征随时间变化的遗忘问题。
Dynamic Time-aware Continual User Representation Learning
- 设计时间感知机制,动态适应物品分布变化
- 在真实时间流场景下优于现有方法,显著缓解灾难性遗忘
- 适合长期在线推荐系统和持续学习研究者
传统用户建模方法多针对单一任务设计,缺乏跨任务泛化与适应能力。近年研究转向基于持续学习的通用用户表征学习,旨在构建可处理多任务的统一模型。然而现有方法评估场景不切实际,未考虑任务演进过程中的时间流逝,忽略了新出现物品带来的物品分布变化。本文提出一种更贴近现实的评估场景,同时提出名为DITTO的新框架,通过时间感知机制缓解因物品分布持续变化导致的灾难性遗忘,并使旧任务知识能自适应当前分布。大量实验表明,DITTO在该真实场景下显著优于现有先进方法。代码已开源。
原文摘要 · Abstract (English)
Traditional user modeling (UM) approaches have primarily focused on designing models for a single specific task, but they face limitations in generalization and adaptability across various tasks. Recognizing these challenges, recent studies have shifted towards continual learning (CL)-based universal user representation learning aiming to develop a single model capable of handling multiple tasks. Despite advancements, existing methods are in fact evaluated under an unrealistic scenario that does not consider the passage of time as tasks progress, which overlooks newly emerged items that may change the item distribution of previous tasks. In this paper, we introduce a practical evaluation scenario on which CL-based universal user representation learning approaches should be evaluated, which takes into account the passage of time as tasks progress. Then, we propose a novel framework Dynamic Time-aware continual user representation learner, named DITTO, designed to alleviate catastrophic forgetting despite continuous shifts in item distribution, while also allowing the knowledge acquired from previous tasks to adapt to the current shifted item distribution. Through our extensive experiments, we demonstrate the superiority of DITTO over state-of-the-art methods under a practical evaluation scenario. Our source code is available at https://github.com/seungyoon-Choi/DITTO_official.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。