不用预设公式,用可学习的单调函数融合多任务推荐结果。
xMTF: A Formula-Free Model for Reinforcement-Learning-Based Multi-Task Fusion in Recommender Systems
- 基于单调函数组合替代固定公式,扩大推荐融合搜索空间
- 在多个数据集上显著提升点击率、点赞率等多指标表现
- 适合需要动态调整推荐权重的电商、内容平台场景
推荐系统需优化多种用户反馈,如点击、点赞和分享。典型系统包含多任务学习(MTL)模块预测各反馈率,以及多任务融合(MTF)模块将预测结果合并为综合评分用于排序。MTF直接影响用户满意度,近年来有研究采用强化学习(RL)优化长期体验。但现有方法依赖预定义公式,仅调整有限系数,限制了探索空间。本文提出无公式框架xMTF,依据Sprecher表示定理,证明任意有效融合函数可表示为单变量单调函数的复合。据此设计可学习的单调融合单元(MFC),取代传统公式。采用两阶段混合(TSH)训练策略,有效训练xMTF。实验表明,通过扩展搜索空间,xMTF在多个离线与在线测试中优于现有方法。
原文摘要 · Abstract (English)
Recommender systems need to optimize various types of user feedback, e.g., clicks, likes, and shares. A typical recommender system handling multiple types of feedback has two components: a multi-task learning (MTL) module, predicting feedback such as click-through rate and like rate; and a multi-task fusion (MTF) module, integrating these predictions into a single score for item ranking. MTF is essential for ensuring user satisfaction, as it directly influences recommendation outcomes. Recently, reinforcement learning (RL) has been applied to MTF tasks to improve long-term user satisfaction. However, existing RL-based MTF methods are formula-based methods, which only adjust limited coefficients within pre-defined formulas. The pre-defined formulas restrict the RL search space and become a bottleneck for MTF. To overcome this, we propose a formula-free MTF framework. We demonstrate that any suitable fusion function can be expressed as a composition of single-variable monotonic functions, as per the Sprecher Representation Theorem. Leveraging this, we introduce a novel learnable monotonic fusion cell (MFC) to replace pre-defined formulas. We call this new MFC-based model eXtreme MTF (xMTF). Furthermore, we employ a two-stage hybrid (TSH) learning strategy to train xMTF effectively. By expanding the MTF search space, xMTF outperforms existing methods in extensive offline and online experiments.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。