arXiv:2507.03895cs.IRcs.AI2025-07KDD被引 7

提出轻量级特征组合选择方法,提升推荐系统性能并降低内存开销。

TayFCS: Towards Light Feature Combination Selection for Deep Recommender Systems

  • 基于泰勒展开的梯度评分,单次反向传播即可评估组合重要性。
  • 在三个基准数据集上显著提升模型效果,且训练效率远高于传统方法。
  • 适合大规模推荐系统部署,尤其关注性能与资源平衡的工业场景。

特征交互建模对深度推荐系统至关重要。常用方法是显式构造特征组合以增强性能,但实践中仅有少量组合真正有效。因此,筛选有用组合可减少噪声并控制内存消耗。尽管特征选择已广泛研究,但现有方法多局限于单个特征选择,难以扩展至高阶组合。由于组合数量随阶数呈指数增长,逐个评估其重要性计算成本极高。本文提出轻量级特征组合选择方法 TayFCS,核心为泰勒展开评分器(TayScorer),通过字段级泰勒展开对基模型进行近似,无需反复实验增删特征,仅需一次反向传播即可基于子项梯度估算组合重要性。为进一步消除组合与其子项间的冗余信息,引入逻辑回归消减(LRE),根据模型预测性能估计信息增益。在三个基准数据集上的实验验证了方法的有效性与高效性。线上A/B测试结果进一步证明其实际应用价值与商业潜力。

原文摘要 · Abstract (English)

Feature interaction modeling is crucial for deep recommendation models. A common and effective approach is to construct explicit feature combinations to enhance model performance. However, in practice, only a small fraction of these combinations are truly informative. Thus it is essential to select useful feature combinations to reduce noise and manage memory consumption. While feature selection methods have been extensively studied, they are typically limited to selecting individual features. Extending these methods for high-order feature combination selection presents a significant challenge due to the exponential growth in time complexity when evaluating feature combinations one by one. In this paper, we propose $\textbf{TayFCS}$, a lightweight feature combination selection method that significantly improves model performance. Specifically, we propose the Taylor Expansion Scorer (TayScorer) module for field-wise Taylor expansion on the base model. Instead of evaluating all potential feature combinations' importance by repeatedly running experiments with feature adding and removal, this scorer only needs to approximate the importance based on their sub-components' gradients. This can be simply computed with one backward pass based on a trained recommendation model. To further reduce information redundancy among feature combinations and their sub-components, we introduce Logistic Regression Elimination (LRE), which estimates the corresponding information gain based on the model prediction performance. Experimental results on three benchmark datasets validate both the effectiveness and efficiency of our approach. Furthermore, online A/B test results demonstrate its practical applicability and commercial value.

推荐系统特征选择轻量化工业落地

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。