通过批量打乱实现可扩展的特征优化,显著提升推荐系统效率。
ShuffleGate: Scalable Feature Optimization for Recommender Systems via Batch-wise Sensitivity Learning
- 用批量打乱方式评估特征重要性,无需复杂阈值调整。
- 处理2.7亿参数仅需700秒,速度比基线快15倍。
- 工业级部署中压缩输入维度10倍,训练吞吐量提升91%。
特征优化(包括特征选择与维度选择)对大规模推荐系统的效率和泛化能力至关重要。传统方法常因重要性评分模糊或计算成本高而受限。本文提出ShuffleGate,一种统一且可解释的机制,通过测量模型对信息丢失的敏感度来估计组件重要性。不同于学习相对权重的常规门控,ShuffleGate引入批量打乱策略,以端到端可微方式有效“擦除”信息。该范式转变带来自然极化的重视分布,弥合了长期存在的“搜索-重训差距”,在无需复杂阈值调优的情况下区分关键信号与噪声。在四个基准上的实验表明,ShuffleGate在特征与维度选择任务中均优于现有最优方法。其处理2.7亿参数仅需700秒,较置换基线提速15倍,并展现出极强可扩展性。在顶级工业部署中,输入维度压缩10倍,训练吞吐量提升91%,同时支撑每日数十亿请求,性能无下降。
原文摘要 · Abstract (English)
Feature optimization -- specifically Feature Selection (FS) and Dimension Selection (DS) -- is critical for the efficiency and generalization of large-scale recommender systems. While conceptually related, these tasks are typically tackled with isolated solutions that often suffer from ambiguous importance scores or prohibitive computational costs. In this paper, we propose ShuffleGate, a unified and interpretable mechanism that estimates component importance by measuring the model's sensitivity to information loss. Unlike conventional gating that learns relative weights, ShuffleGate introduces a batch-wise shuffling strategy to effectively "erase" information in an end-to-end differentiable manner. This paradigm shift yields naturally polarized importance distributions, bridging the long-standing "search-retrain gap" and distinguishing essential signals from noise without complex threshold tuning. Extensive experiments across four benchmarks validate that ShuffleGate consistently outperforms state-of-the-art methods in both Feature and Dimension Selection tasks. It achieves a 15\times speedup over permutation baselines and demonstrates extreme scalability by processing 270M parameters in just 700 seconds. Finally, in a top-tier industrial deployment, it compressed input dimensions by 10\times, yielding a 91% increase in training throughput while serving billions of daily requests without performance degradation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。