arXiv:2602.20001cs.IRcs.LG2026-02中稿 · The Web Conference…被引 2

解决推荐系统中特征选择的三种偏差问题,提升特征重要性评估准确性。

FairFS: Addressing Deep Feature Selection Biases for Recommender System

  • 通过全层正则化缓解模型层间重要性估计偏差
  • 引入平滑基线与聚合近似法降低基线和近似偏差
  • 适用于工业级推荐系统特征筛选,提升线上性能与效率

大规模在线市场和推荐系统是电商发展的重要技术支撑。在工业推荐系统中,特征承载着下游模型所需信息,准确估计特征重要性至关重要,有助于从数千个候选特征中选出最有用的子集,从而提升线上表现并降低计算开销。针对深度学习中的特征选择问题,可训练门控和敏感性方法已被提出并在工业实践中证明有效。然而,通过对真实案例的分析,我们发现三种偏差问题:特征重要性估计依赖于部分模型层、样本或梯度,导致评估不准确,分别称为层偏差、基线偏差和近似偏差。为此,我们提出FairFS,一种公平且准确的特征选择算法。FairFS通过在所有非线性变换层上正则化特征重要性以缓解层偏差;引入接近分类器决策边界的平滑基线特征,并采用聚合近似方法减轻基线和近似偏差。大量实验表明,FairFS能有效缓解上述偏差,实现当前最优的特征选择性能。

原文摘要 · Abstract (English)

Large-scale online marketplaces and recommender systems serve as critical technological support for e-commerce development. In industrial recommender systems, features play vital roles as they carry information for downstream models. Accurate feature importance estimation is critical because it helps identify the most useful feature subsets from thousands of feature candidates for online services. Such selection enables improved online performance while reducing computational cost. To address feature selection problems in deep learning, trainable gate-based and sensitivity-based methods have been proposed and proven effective in industrial practice. However, through the analysis of real-world cases, we identified three bias issues that cause feature importance estimation to rely on partial model layers, samples, or gradients, ultimately leading to inaccurate importance estimation. We refer to these as layer bias, baseline bias, and approximation bias. To mitigate these issues, we propose FairFS, a fair and accurate feature selection algorithm. FairFS regularizes feature importance estimated across all nonlinear transformation layers to address layer bias. It also introduces a smooth baseline feature close to the classifier decision boundary and adopts an aggregated approximation method to alleviate baseline and approximation biases. Extensive experiments demonstrate that FairFS effectively mitigates these biases and achieves state-of-the-art feature selection performance.

推荐系统特征选择深度学习偏差修正

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。