用双流MLP提升点击率预测,简单高效还更准。
Dual-Stream MLP is All You Need for CTR Prediction
- 双流MLP分别学习显式与隐式特征交互,分工明确
- 蒸馏技术让主网络吸收显式交互能力,减少冗余计算
- 适合追求高精度与低延迟的推荐系统部署
点击率(CTR)预测在在线广告与推荐系统中至关重要,微小提升即可显著增加收益。现有方法多采用双流架构以捕捉显式与隐式特征间的复杂交互,但面临两大挑战:一是特征交互学习复杂度高,增加计算负担并提高过拟合风险;二是显式与隐式模块间存在不平衡,一方输出可能主导最终预测。为此,本文提出双流MLP(DS-MLP),一种新颖的特征交互框架。它通过知识蒸馏将显式特征交互能力迁移到主MLP网络,同时并行的另一MLP负责捕捉隐式交互作为补充。为有效优化双流结构,设计了包含两项对齐策略的特定训练方法,增强两模块兼容性。实验表明,尽管最终模型仅为普通MLP结构,DS-MLP在三个主流基准上均达到当前最优性能,为大规模推荐系统提供了可扩展、高效的解决方案。代码已开源。
原文摘要 · Abstract (English)
Click-through rate (CTR) prediction holds a pivotal role in online advertising and recommendation systems, where even small improvements can significantly boost revenue. Existing research primarily focuses on designing dual-stream architectures to capture effective complex feature interactions from both explicit and implicit perspectives. However, these approaches are faced with two major challenges: 1) the high complexity of feature interaction learning, which increases computational demands and the overfitting risk, and 2) the imbalance between explicit and implicit modules, where one module's output may dominate the final prediction. To address these issues, in this paper, we propose Dual-Stream MLP (DS-MLP), a novel feature interaction framework for the CTR prediction task. Specially, it leverages knowledge distillation to consolidate the capacity of learning explicit feature interaction into a main MLP network, while a parallel MLP simultaneously captures implicit feature interactions as a complement. To effectively optimize the dual-stream MLP architecture, we further design a specific learning approach with two alignment strategies for enhancing the compatibility of the two MLP components. Experiments demonstrate that DS-MLP, though merely a vanilla MLP structure (the final model), can achieve state-of-the-art performance across three widely used benchmarks, offering a scalable and efficient solution for large-scale recommendation systems. Our code is available at https://github.com/RUCAIBox/DS-MLP.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。