arXiv:2412.08911cs.LGcs.AI2024-12

用多目标条件监督学习提升推荐系统平衡性能与抗噪能力

Goal-Conditioned Supervised Learning for Multi-Objective Recommendation

  • 将目标从单一数值扩展为多维向量,自动学习多目标最优策略
  • 在真实数据集上实现高平衡性能,且对噪声数据鲁棒性更强
  • 适合需要兼顾多个指标的工业级推荐场景,如电商、内容平台

多目标学习旨在通过单一模型同时优化多个目标,以在不同目标间取得高性能且平衡的表现。然而,这常带来更复杂的优化问题,尤其当目标间存在冲突时,导致内存和计算开销增加。本文提出一种多目标条件监督学习(MOGCSL)框架,从离线序列数据中自动学习实现多重目标。MOGCSL 将传统 GCSL 的一维目标扩展为多维向量目标,无需复杂架构或优化约束,自然消除冗余设计。此外,该方法能有效过滤无法在多个目标上达成理想长期奖励的无效或噪声样本。我们还提出一种新型目标选择算法,用于在推理阶段建模并识别“可实现的高目标”。尽管框架通用,本文聚焦其在商业推荐系统中下一动作预测的应用。实验表明,MOGCSL 在真实推荐数据集上表现优异,兼具良好可扩展性与对大量噪声数据的鲁棒性。分析与实验进一步揭示其在多目标推荐中抑制噪声训练样本的有效机制。

原文摘要 · Abstract (English)

Multi-objective learning endeavors to concurrently optimize multiple objectives using a single model, aiming to achieve high and balanced performance across diverse objectives. However, this often entails a more complex optimization problem, particularly when navigating potential conflicts between objectives, leading to solutions with higher memory requirements and computational complexity. This paper introduces a Multi-Objective Goal-Conditioned Supervised Learning (MOGCSL) framework for automatically learning to achieve multiple objectives from offline sequential data. MOGCSL extends the conventional GCSL method to multi-objective scenarios by redefining goals from one-dimensional scalars to multi-dimensional vectors. It benefits from naturally eliminating the need for complex architectures and optimization constraints. Moreover, MOGCSL effectively filters out uninformative or noisy instances that fail to achieve desirable long-term rewards across multiple objectives. We also introduces a novel goal-selection algorithm for MOGCSL to model and identify "high" achievable goals for inference. While MOGCSL is quite general, we focus on its application to the next action prediction problem in commercial-grade recommender systems. In this context, any viable solution needs to be reasonably scalable and also be robust to large amounts of noisy data that is characteristic of this application space. We show that MOGCSL performs admirably on both counts by extensive experiments on real-world recommendation datasets. Also, analysis and experiments are included to explain its strength in discounting the noisier portions of training data in recommender systems with multiple objectives.

多目标推荐监督学习推荐系统抗噪学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。