让生成模型在训练和推理时都发挥作用,提升点击率预测准确率
Infer As You Train: A Symmetric Paradigm of Masked Generative for Click-Through Rate Prediction
- 训练时学特征依赖,推理时迭代重定义输入特征
- 在多个数据集上显著优于传统判别模型,提升点击率预测效果
- 适合追求高精度推荐系统建模的工程师与研究者
生成模型在点击率(CTR)预测领域逐渐受到关注,旨在克服传统判别范式仅依赖二分类目标的局限。然而,现有生成模型通常仅在训练阶段使用生成能力用于表征学习,线上推理时仍回归标准判别范式,未能充分发挥其生成能力。这种训练与推理之间的根本不对称性限制了生成范式的潜力。为此,我们提出对称掩码生成范式SGCTR,实现训练与推理阶段的对称性。具体而言,在训练中学习特征依赖关系后,SGCTR在在线推理阶段利用生成能力,迭代重构输入样本的特征,缓解噪声特征的影响,从而提升预测准确性。大量实验验证了SGCTR的优势,表明在训练与推理中对称应用生成范式能显著释放其在CTR预测中的潜力。
原文摘要 · Abstract (English)
Generative models are increasingly being explored in click-through rate (CTR) prediction field to overcome the limitations of the conventional discriminative paradigm, which rely on a simple binary classification objective. However, existing generative models typically confine the generative paradigm to the training phase, primarily for representation learning. During online inference, they revert to a standard discriminative paradigm, failing to leverage their powerful generative capabilities to further improve prediction accuracy. This fundamental asymmetry between the training and inference phases prevents the generative paradigm from realizing its full potential. To address this limitation, we propose the Symmetric Masked Generative Paradigm for CTR prediction (SGCTR), a novel framework that establishes symmetry between the training and inference phases. Specifically, after acquiring generative capabilities by learning feature dependencies during training, SGCTR applies the generative capabilities during online inference to iteratively redefine the features of input samples, which mitigates the impact of noisy features and enhances prediction accuracy. Extensive experiments validate the superiority of SGCTR, demonstrating that applying the generative paradigm symmetrically across both training and inference significantly unlocks its power in CTR prediction.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。