arXiv:2502.19628cs.IR2025-02中稿 · www'25 as short pa…被引 4

用提示词缓解推荐系统中遗忘问题,提升用户建模持续学习能力。

PCL: Prompt-based Continual Learning for User Modeling in Recommender Systems

  • 用位置提示词作为任务外部记忆,避免知识丢失。
  • 引入上下文提示捕捉任务间关联,增强适应性。
  • 适合需要持续更新用户画像的电商推荐场景。

大型电商平台的用户建模旨在通过整合多种用户行为优化体验。传统单任务模型仅关注特定业务指标,忽略全面用户行为,限制了效果。现有多任务学习方法虽提升泛化性,但面临优化失衡与新任务适配效率低的问题。持续学习(CL)可增量学习新任务,但存在灾难性遗忘。受预训练语言模型提示调优启发,本文提出PCL:基于提示的持续学习框架,为每个任务设计位置提示词作为外部记忆,保留旧知识并缓解遗忘。同时引入上下文提示,捕获任务间关系。在真实数据集上实验验证了其有效性。

原文摘要 · Abstract (English)

User modeling in large e-commerce platforms aims to optimize user experiences by incorporating various customer activities. Traditional models targeting a single task often focus on specific business metrics, neglecting the comprehensive user behavior, and thus limiting their effectiveness. To develop more generalized user representations, some existing work adopts Multi-task Learning (MTL)approaches. But they all face the challenges of optimization imbalance and inefficiency in adapting to new tasks. Continual Learning (CL), which allows models to learn new tasks incrementally and independently, has emerged as a solution to MTL's limitations. However, CL faces the challenge of catastrophic forgetting, where previously learned knowledge is lost when the model is learning the new task. Inspired by the success of prompt tuning in Pretrained Language Models (PLMs), we propose PCL, a Prompt-based Continual Learning framework for user modeling, which utilizes position-wise prompts as external memory for each task, preserving knowledge and mitigating catastrophic forgetting. Additionally, we design contextual prompts to capture and leverage inter-task relationships during prompt tuning. We conduct extensive experiments on real-world datasets to demonstrate PCL's effectiveness.

推荐系统持续学习提示调优

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。