arXiv:2606.01111cs.LG2026-06

提出可学习的特征选择模块,高效处理稀疏异构推荐系统中的海量特征。

LeAP: Learnable Adaptive Permutation for Feature Selection in Heterogeneous and Sparse Recommender Systems

论文配图:LeAP: Learnable Adaptive Permutation for Feature Selection in Heterogeneous and Sparse Recommender Systems
图 1 · 摘自论文原文
  • 用可学习的自适应排列替代随机排列,加速特征重要性评估。
  • 在12000+特征中识别并移除超3600个冗余特征,性能无损。
  • 适合工业级大规模推荐系统,尤其擅长处理极端稀疏场景。

现代工业推荐系统依赖数千个异构特征(从低维标量到高维嵌入)实现高精度预测。由于训练成本巨大,高效特征选择至关重要。现有方法存在三大瓶颈:(1) 通常假设特征维度一致或需昂贵映射至固定尺寸;(2) 难以应对极端稀疏性(如99%+特征保持默认值);(3) 传统基于排列的方法在大规模场景下计算开销过高。为此,我们提出LeAP(Learnable Adaptive Permutation),一种新型、模型无关的插件式特征选择模块。LeAP将低效的随机排列转化为可学习机制,显著加速特征重要性评估。同时引入针对异构维度与极端稀疏性的自适应正则化策略,实现跨非对称输入空间的优越排序效果。在四个公开推荐数据集上的实验表明,LeAP达到当前最优性能。此外,该方法已部署于日请求超十亿、模型参数达2TB的工业搜索排序系统中。在此真实场景(总特征维度12,000+)下,LeAP成功识别并移除超过3,600个冗余维度,且未造成性能下降,其能力为基线方法的2至10倍。

原文摘要 · Abstract (English)

Modern industrial recommender systems rely on thousands of heterogeneous features -- ranging from low-dimensional scalars (e.g., statistical value) to high-dimensional embeddings (e.g., user-id embeddings, MLP representations) -- to achieve high-precision predictions. Given the immense computational costs associated with training, efficient feature selection is critical. However, existing methods encounter three primary bottlenecks: (1) they typically assume uniform feature dimensions or require costly mapping to a fixed size; (2) they struggle with extreme sparsity, where the majority of features (e.g., 99%+) remain at default values; and (3) traditional permutation-based approaches are computationally prohibitive in large-scale settings. To address these challenges, we propose LeAP (Learnable Adaptive Permutation), a novel, model-agnostic plug-in module for feature selection. LeAP transforms the inefficient random permutation process into a learnable mechanism, significantly accelerating the evaluation of feature importance. In addition, we introduce an adaptive regularization strategy tailored for heterogeneous dimensions and extreme sparsity, enabling superior feature importance ranking results across asymmetric input spaces. Experiments on four public recommendation datasets demonstrate that LeAP achieves state-of-the-art performance. Furthermore, LeAP has been deployed in a large-scale industrial search ranking model with over a billion daily requests and a 2TB model parameter scale. In this real-world scenario involving 12,000+ total feature dimensions, LeAP successfully identified and removed over 3,600 redundant dimensions without performance degradation, which is 2 to 10 times the ability of compared baseline methods.

推荐系统特征选择稀疏性可学习排列

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。