用轻量本地过滤器,低成本高效筛选广告推荐中的关键稀疏特征。
LO-FAR: A Cost-Aware Local Filter for Sparse Feature Ranking in Industrial Ad Recommendation

- 基于独立特征的局部估计,避免重训耗时
- 2小时完成百万级数据特征排序,保留90%以上预测效果
- 适合资源受限、迭代快的工业级推荐系统
工业广告推荐模型严重依赖稀疏高基数的ID列表特征,如用户行为历史和上下文标识符。每个特征对应一个嵌入表,导致存储、训练与服务成本高昂,且需随流量和下游模型变化持续优化。因此,稀疏特征排序不仅是离线建模问题,更是受算力预算和迭代周期限制的系统性决策。本文提出LO-FAR——一种仅使用CPU、模型无关的局部特征排序流程,通过轻量级局部估计器评估各候选特征的独立预测信号,而非依赖GPU绑定的重训循环。在包含超过一百万条日志交互和475个稀疏特征的真实数据集上,LO-FAR仅耗时约两小时完成排序,并在100至400个保留特征的预算范围内,保持与洗牌基线、二值随机神经元及覆盖率启发式方法相当的点击率(CTR)与转化率(CVR)任务上的归一化熵增益。该工作展示:当成本与响应时间受限时,简单局部过滤器可成为比复杂交互感知方案更实用的生产选择。
原文摘要 · Abstract (English)
Industrial ad recommendation models rely heavily on sparse, high-cardinality ID-list features that encode user histories and contextual identifiers. Each is backed by a dedicated embedding table, so these features dominate storage, training, and serving cost and must be revisited as traffic and downstream models evolve. Therefore, sparse feature ranking is not just an offline modeling problem but also a recurrent systems decision limited by compute budgets and iteration cadence. We present Localized Feature Ranking (LO-FAR), a CPU-only, model-agnostic workflow that ranks each candidate feature from its stand-alone held-out predictive signal using lightweight local estimators rather than the GPU-bound retraining loops of permutation- and stochastic-gate-based methods. On a production dataset of more than one million logged interactions and 475 sparse ID-list features, LO-FAR completes ranking in approximately two CPU-hours and preserves downstream Normalized Entropy gains on CTR and CVR tasks that are competitive with shuffle-based importance, Binary Stochastic Neurons, and a coverage-based heuristic across budgets of 100--400 retained features. The contribution is a deployable workflow showing that, when cost and turnaround constraints are binding, a simple local filter can be a practical production choice over heavier interaction-aware alternatives.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。