arXiv:2411.15223cs.LG2024-11被引 2

改进xDeepFM模型,提升广告点击率预测精度。

An accuracy improving method for advertising click through rate prediction based on enhanced xDeepFM model

  • 引入多头注意力机制捕捉多维度特征交互
  • 用因子分解机替代线性层,更好处理稀疏数据
  • 在Criteo数据集上显著提升AUC与Logloss

广告点击率(CTR)预测旨在预估用户在特定情境下点击广告的概率,为产品排序和广告投放提供决策支持。然而,该任务面临数据稀疏性和类别不平衡等挑战,影响模型训练效果。此外,现有多数模型未能从多个角度充分挖掘用户历史、兴趣与目标广告之间的关联,忽略不同层级的重要信息。为此,本文提出基于xDeepFM架构的改进型CTR预测模型。通过集成多头注意力机制,模型可同时关注特征交互的不同方面,增强对复杂模式的学习能力,且计算开销增加有限。同时,以因子分解机(FM)替代线性模块,更灵活地捕捉高维稀疏数据的一阶与二阶特征交互。在Criteo数据集上的实验表明,所提模型优于其他先进方法,在AUC和Logloss指标上均有显著提升,有助于更有效地挖掘特征间的隐含关系,提高广告点击率预测准确性。

原文摘要 · Abstract (English)

Advertising click-through rate (CTR) prediction aims to forecast the probability that a user will click on an advertisement in a given context, thus providing enterprises with decision support for product ranking and ad placement. However, CTR prediction faces challenges such as data sparsity and class imbalance, which adversely affect model training effectiveness. Moreover, most current CTR prediction models fail to fully explore the associations among user history, interests, and target advertisements from multiple perspectives, neglecting important information at different levels. To address these issues, this paper proposes an improved CTR prediction model based on the xDeepFM architecture. By integrating a multi-head attention mechanism, the model can simultaneously focus on different aspects of feature interactions, enhancing its ability to learn intricate patterns without significantly increasing computational complexity. Furthermore, replacing the linear model with a Factorization Machine (FM) model improves the handling of high-dimensional sparse data by flexibly capturing both first-order and second-order feature interactions. Experimental results on the Criteo dataset demonstrate that the proposed model outperforms other state-of-the-art methods, showing significant improvements in both AUC and Logloss metrics. This enhancement facilitates better mining of implicit relationships between features and improves the accuracy of advertising CTR prediction.

CTR预测xDeepFM广告推荐

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。