自动学习点击率模型中的特征融合方式,提升预测效果。
Fusion Matters: Learning Fusion in Deep Click-through Rate Prediction Models
- 提出OptFusion,同时学习融合连接与操作
- 在三个大规模数据集上显著提升点击率预测性能
- 适合需要优化特征融合的推荐系统研究者
以往点击率(CTR)模型的发展主要依赖于复杂组件的设计,用于建模特征交互。然而,对融合设计的改进关注较少,通常采用堆叠或并行这两种固定模式,依赖预设连接和操作。已有研究表明,融合方式的变化会显著影响模型表现,凸显其关键作用。尽管已有研究尝试优化基本融合策略,但多受限于特定场景或依赖特定组件。神经架构搜索虽被引入以解决融合设计问题,但搜索空间复杂导致效率与效果不佳。为此,我们提出OptFusion,一种可自动学习融合连接与操作的方法,并设计了一种一次性学习算法同步完成两项任务。在三个大规模数据集上的实验表明,OptFusion在提升性能的同时保持高效率。代码已开源。
原文摘要 · Abstract (English)
The evolution of previous Click-Through Rate (CTR) models has mainly been driven by proposing complex components, whether shallow or deep, that are adept at modeling feature interactions. However, there has been less focus on improving fusion design. Instead, two naive solutions, stacked and parallel fusion, are commonly used. Both solutions rely on pre-determined fusion connections and fixed fusion operations. It has been repetitively observed that changes in fusion design may result in different performances, highlighting the critical role that fusion plays in CTR models. While there have been attempts to refine these basic fusion strategies, these efforts have often been constrained to specific settings or dependent on specific components. Neural architecture search has also been introduced to partially deal with fusion design, but it comes with limitations. The complexity of the search space can lead to inefficient and ineffective results. To bridge this gap, we introduce OptFusion, a method that automates the learning of fusion, encompassing both the connection learning and the operation selection. We have proposed a one-shot learning algorithm tackling these tasks concurrently. Our experiments are conducted over three large-scale datasets. Extensive experiments prove both the effectiveness and efficiency of OptFusion in improving CTR model performance. Our code implementation is available here\url{https://github.com/kexin-kxzhang/OptFusion}.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。