arXiv:2410.10639cs.IR2024-10被引 6

无需重训,一键生成适配新需求的推荐模型参数。

Paragon: Parameter Generation for Controllable Multi-Task Recommendation

  • 用生成模型学习不同任务下的最优参数分布
  • 测试时仅需几秒即可生成新参数,计算量降低94.6%以上
  • 可嵌入现有推荐系统,适合需要快速响应变化的场景

商业推荐系统常面临平台或用户需求动态变化(如对精度与多样性偏好改变)的问题。理想情况下,应重新训练模型以适应新目标函数,但在线部署后重训成本过高,难以实践。为此,我们提出一种可控多任务推荐参数生成方法(Paragon),可在不重训的前提下,通过调整模型参数来适配新任务需求。首先基于可行任务要求通过适配器微调获取优化参数;然后利用生成模型作为参数生成器,结合无分类器引导进行条件训练,学习不同任务下参数的分布;最后在测试阶段,根据任务需求高效生成对应参数。该方法可无缝集成至多种推荐模型中。在两个公开数据集和一个商用数据集上的实验表明,相比传统重训,Paragon将计算时间减少至少94.6%。代码已开源。

原文摘要 · Abstract (English)

Commercial recommender systems face the challenge that task requirements from platforms or users often change dynamically (e.g., varying preferences for accuracy or diversity). Ideally, the model should be re-trained after resetting a new objective function, adapting to these changes in task requirements. However, in practice, the high computational costs associated with retraining make this process impractical for models already deployed to online environments. This raises a new challenging problem: how to efficiently adapt the learned model to different task requirements by controlling the model parameters after deployment, without the need for retraining. To address this issue, we propose a novel controllable learning approach via \textbf{para}meter \textbf{g}eneration for c\textbf{on}trollable multi-task recommendation (\textbf{Paragon}), which allows the customization and adaptation of recommendation model parameters to new task requirements without retraining. Specifically, we first obtain the optimized model parameters through adapter tunning based on the feasible task requirements. Then, we utilize the generative model as a parameter generator, employing classifier-free guidance in conditional training to learn the distribution of optimized model parameters under various task requirements. Finally, the parameter generator is applied to effectively generate model parameters in a test-time adaptation manner given task requirements. Moreover, Paragon seamlessly integrates with various existing recommendation models to enhance their controllability. Extensive experiments on two public datasets and one commercial dataset demonstrate that Paragon can efficiently generate model parameters instead of retraining, reducing computational time by at least 94.6\%. The code is released at \href{https://github.com/bubble65/Paragon}{https://github.com/bubble65/Paragon}.

推荐系统参数生成可控性零重训

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。