arXiv:2509.12076cs.IR2025-09中稿 · TKDE被引 2

提出自适应早期特征选择,高效减少推荐系统参数量

AEFS: Adaptive Early Feature Selection for Deep Recommender Systems

  • 双模型架构:辅助模型选特征,主模型做预测
  • 在保持性能的同时,嵌入层激活参数减少37.5%
  • 适合大规模推荐系统,尤其关注效率与稀疏性场景

特征选择已成为优化推荐系统的关键技术。现有方法主要分为早期与晚期特征选择,前者在嵌入层前固定筛选特征,后者即自适应特征选择,在嵌入后动态调整每条数据的特征。尽管自适应方法表现优异,但其在嵌入层后操作,导致千亿级ID型特征的大规模推荐系统中嵌入层极度稀疏且参数冗余。为此,我们提出自适应早期特征选择(AEFS),在嵌入前对每个样本动态选择关键特征,显著降低嵌入层激活参数。AEFS采用双模型结构,包含专用特征选择的辅助模型和负责预测的主模型,并引入双重协同训练损失以确保两模型对齐。在三个基准数据集上的大量实验表明,AEFS性能媲美当前最优自适应晚期特征选择方法,同时使嵌入层激活参数减少37.5%。代码已开源:https://github.com/fly-dragon211/AEFS。

原文摘要 · Abstract (English)

Feature selection has emerged as a crucial technique in refining recommender systems. Recent advancements leveraging Automated Machine Learning (AutoML) has drawn significant attention, particularly in two main categories: early feature selection and late feature selection, differentiated by whether the selection occurs before or after the embedding layer. The early feature selection selects a fixed subset of features and retrains the model, while the late feature selection, known as adaptive feature selection, dynamically adjusts feature choices for each data instance, recognizing the variability in feature significance. Although adaptive feature selection has shown remarkable improvements in performance, its main drawback lies in its post-embedding layer feature selection. This process often becomes cumbersome and inefficient in large-scale recommender systems with billions of ID-type features, leading to a highly sparse and parameter-heavy embedding layer. To overcome this, we introduce Adaptive Early Feature Selection (AEFS), a very simple method that not only adaptively selects informative features for each instance, but also significantly reduces the activated parameters of the embedding layer. AEFS employs a dual-model architecture, encompassing an auxiliary model dedicated to feature selection and a main model responsible for prediction. To ensure effective alignment between these two models, we incorporate two collaborative training loss constraints. Our extensive experiments on three benchmark datasets validate the efficiency and effectiveness of our approach. Notably, AEFS matches the performance of current state-of-theart Adaptive Late Feature Selection methods while achieving a significant reduction of 37. 5% in the activated parameters of the embedding layer. AEFS is open-source at https://github. com/fly-dragon211/AEFS .

推荐系统特征选择嵌入优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。