提出新算法提升点击率预测精度,同时降低计算开销。
NeSHFS: Neighborhood Search with Heuristic-based Feature Selection for Click-Through Rate Prediction
- 基于邻域搜索与启发式筛选,动态选择关键特征
- 在三个数据集上实现更高点击率预测性能
- 适合资源受限的实时推荐系统部署
点击率(CTR)预测在在线广告和推荐系统中至关重要。过去十年,提升CTR一直是模型研发的核心目标。现有研究多聚焦于捕捉隐式或显式特征交互,但显式交互尤其是低阶与高阶特征组合的提取仍具挑战。冗余无关特征会增加计算时间并降低预测效果,且某些特征在不同模型下表现差异显著,特征分布也随流量波动。在实际生产环境中,推理时间与训练时间同样关键。因此,高效的特征选择成为提升模型性能的关键。传统过滤类方法效果有限。本文提出一种名为邻域搜索结合启发式特征选择(NeSHFS)的启发式算法,在降低维度和训练成本的同时提升CTR预测性能。我们在三个公开数据集上进行了全面实验,验证了该方法的有效性与高效性。
原文摘要 · Abstract (English)
Click-through-rate (CTR) prediction plays an important role in online advertising and ad recommender systems. In the past decade, maximizing CTR has been the main focus of model development and solution creation. Therefore, researchers and practitioners have proposed various models and solutions to enhance the effectiveness of CTR prediction. Most of the existing literature focuses on capturing either implicit or explicit feature interactions. Although implicit interactions are successfully captured in some studies, explicit interactions present a challenge for achieving high CTR by extracting both low-order and high-order feature interactions. Unnecessary and irrelevant features may cause high computational time and low prediction performance. Furthermore, certain features may perform well with specific predictive models while underperforming with others. Also, feature distribution may fluctuate due to traffic variations. Most importantly, in live production environments, resources are limited, and the time for inference is just as crucial as training time. Because of all these reasons, feature selection is one of the most important factors in enhancing CTR prediction model performance. Simple filter-based feature selection algorithms do not perform well and they are not sufficient. An effective and efficient feature selection algorithm is needed to consistently filter the most useful features during live CTR prediction process. In this paper, we propose a heuristic algorithm named Neighborhood Search with Heuristic-based Feature Selection (NeSHFS) to enhance CTR prediction performance while reducing dimensionality and training time costs. We conduct comprehensive experiments on three public datasets to validate the efficiency and effectiveness of our proposed solution.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。