通过扩大推荐系统的监督信号,提升模型稳定性与泛化能力。
Scaled Supervision is an Implicit Lipschitz Regularizer
- 用细粒度反馈替代二值点击标签,增强监督信息
- 实验证明放大监督可隐式实现Lipschitz正则化,降低过拟合
- 无需调参即可稳定提升现有推荐模型性能
在现代社交媒体中,推荐系统(RecSys)通常以点击率(CTR)作为用户参与度的评估标准。传统上,CTR预测被建模为二分类任务,判断用户是否会与某物品互动。然而,这种做法忽略了真实社交场景中用户、物品及其交互特征在快速变化的在线环境中的动态性。这种动态性常导致模型不稳定,表现为对短期波动的过拟合,而非捕捉高层次的交互模式。尽管过拟合需要更丰富和精细的监督,但当前方法多依赖二值标签,通过阈值处理过度简化了用户偏好,显著削弱了监督信号的丰富性。因此,我们旨在通过增加CTR训练中的监督带宽来缓解过拟合问题。具体而言:(i) 理论上,我们将细粒度偏好对模型稳定性的影响建模为Lipschitz约束;(ii) 实验上,发现扩大监督带宽可充当隐式Lipschitz正则项,稳定优化现有CTR模型,提升泛化能力。大量实验表明,这种扩大的监督能显著且一致地改善优化过程与模型性能,甚至无需额外超参数调优。
原文摘要 · Abstract (English)
In modern social media, recommender systems (RecSys) rely on the click-through rate (CTR) as the standard metric to evaluate user engagement. CTR prediction is traditionally framed as a binary classification task to predict whether a user will interact with a given item. However, this approach overlooks the complexity of real-world social modeling, where the user, item, and their interactive features change dynamically in fast-paced online environments. This dynamic nature often leads to model instability, reflected in overfitting short-term fluctuations rather than higher-level interactive patterns. While overfitting calls for more scaled and refined supervisions, current solutions often rely on binary labels that overly simplify fine-grained user preferences through the thresholding process, which significantly reduces the richness of the supervision. Therefore, we aim to alleviate the overfitting problem by increasing the supervision bandwidth in CTR training. Specifically, (i) theoretically, we formulate the impact of fine-grained preferences on model stability as a Lipschitz constrain; (ii) empirically, we discover that scaling the supervision bandwidth can act as an implicit Lipschitz regularizer, stably optimizing existing CTR models to achieve better generalizability. Extensive experiments show that this scaled supervision significantly and consistently improves the optimization process and the performance of existing CTR models, even without the need for additional hyperparameter tuning.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。