arXiv:2512.14041cs.IR2025-12ICML被引 5

用生成式框架解决点击率预测中的嵌入坍塌问题。

From Feature Interaction to Feature Generation: A Generative Paradigm of CTR Prediction Models

  • 提出监督特征生成框架,替代传统特征交互
  • 在多个数据集上显著减少信息冗余并提升效果
  • 可无缝接入主流推荐模型,适合做推荐系统优化

点击率(CTR)预测是推荐系统的核心任务,旨在估计用户点击物品的概率。现有模型多采用判别式范式,依赖原始ID嵌入的显式交互,但易引发嵌入维度坍塌和信息冗余问题。为此,本文提出一种新型监督特征生成(SFG)框架,将范式从判别式“特征交互”转向生成式“特征生成”。SFG包含编码器(构建各特征的隐表示)和解码器(从隐表示重建所有特征嵌入)。不同于自监督生成方法,SFG引入基于点击标签的监督损失,充分利用任务信号。该框架具备强泛化能力,可无缝集成至多数现有CTR模型中。大量实验表明,SFG能持续缓解嵌入坍塌、降低信息冗余,并在多个数据集与基线模型上实现显著性能提升。代码已开源:https://github.com/USTC-StarTeam/GE4Rec。

原文摘要 · Abstract (English)

Click-Through Rate (CTR) prediction, a core task in recommendation systems, aims to estimate the probability of users clicking on items. Existing models predominantly follow a discriminative paradigm, which relies heavily on explicit interactions between raw ID embeddings. However, this paradigm inherently renders them susceptible to two critical issues: embedding dimensional collapse and information redundancy, stemming from the over-reliance on feature interactions \emph{over raw ID embeddings}. To address these limitations, we propose a novel \emph{Supervised Feature Generation (SFG)} framework, \emph{shifting the paradigm from discriminative ``feature interaction" to generative ``feature generation"}. Specifically, SFG comprises two key components: an \emph{Encoder} that constructs hidden embeddings for each feature, and a \emph{Decoder} tasked with regenerating the feature embeddings of all features from these hidden representations. Unlike existing generative approaches that adopt self-supervised losses, we introduce a supervised loss to utilize the supervised signal, \ie, click or not, in the CTR prediction task. This framework exhibits strong generalizability: it can be seamlessly integrated with most existing CTR models, reformulating them under the generative paradigm. Extensive experiments demonstrate that SFG consistently mitigates embedding collapse and reduces information redundancy, while yielding substantial performance gains across various datasets and base models. The code is available at https://github.com/USTC-StarTeam/GE4Rec.

推荐系统特征生成CTR预测

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。