arXiv:2501.18126cs.IRcs.LG2025-01KDD

用自动调优技术2-3天内优化推荐系统的价值模型权重。

HyperZero: A Customized End-to-End Auto-Tuning System for Recommendation with Hourly Feedback

  • 基于小时级反馈设计端到端自调优框架,快速寻找最优权重。
  • 在2-3天内完成调优,显著快于传统方法的数周甚至数月。
  • 适用于工业级推荐系统,可扩展至其他调优任务。

现代推荐系统主要分为两个阶段:排序阶段预测用户行为(如点击率、点赞率、关注率、观看时长),价值模型阶段则通过函数(如权重向量定义的线性组合)聚合这些分数,生成内容价值的单一数值评分。两阶段在工业系统中同等重要,但第二阶段的模型权重优化缺乏系统研究。本文聚焦于此,提出名为HyperZero的实用自调优系统,解决现有方案耗时过长的问题——传统方法需数周至数月,而生产环境无法容忍次优价值模型带来的用户体验下降。HyperZero在2-3天内完成有效调优,同时应对现代推荐系统的独特挑战,具备向更广范围调优任务扩展的潜力。

原文摘要 · Abstract (English)

Modern recommendation systems can be broadly divided into two key stages: the ranking stage, where the system predicts various user engagements (e.g., click-through rate, like rate, follow rate, watch time), and the value model stage, which aggregates these predictive scores through a function (e.g., a linear combination defined by a weight vector) to measure the value of each content by a single numerical score. Both stages play roughly equally important roles in real industrial systems; however, how to optimize the model weights for the second stage still lacks systematic study. This paper focuses on optimizing the second stage through auto-tuning technology. Although general auto-tuning systems and solutions - both from established production practices and open-source solutions - can address this problem, they typically require weeks or even months to identify a feasible solution. Such prolonged tuning processes are unacceptable in production environments for recommendation systems, as suboptimal value models can severely degrade user experience. An effective auto-tuning solution is required to identify a viable model within 2-3 days, rather than the extended timelines typically associated with existing approaches. In this paper, we introduce a practical auto-tuning system named HyperZero that addresses these time constraints while effectively solving the unique challenges inherent in modern recommendation systems. Moreover, this framework has the potential to be expanded to broader tuning tasks within recommendation systems.

推荐系统自动调优实时优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。