提出轻量级网络实现高效可扩展的推荐特征交互,显著提升广告收益。
Aggregate and Broadcast: Scalable and Efficient Feature Interaction for Recommender Systems
- 用枢纽令牌实现聚合-广播机制,线性复杂度完成跨特征交互
- 在工业数据集上提升点击率1.155%,广告收入增长1.587%
- 支持任务感知交互,保留细粒度行为信号,适合大规模推荐系统
特征交互是大规模推荐系统排序模型的核心,但如何兼顾表达力与高效可扩展性仍具挑战。传统全配对交互具有二次复杂度,而多数高效方法受限于结构,限制信息传递。我们识别出两个实际瓶颈:(1)早期行为序列聚合压缩了细粒度信号,使深层难以复用物品级细节;(2)晚期融合仅在末端注入任务信号,无法引导交互过程。为此,提出信息流网络(INFNet),一种轻量级架构,实现线性复杂度的、任务感知的特征交互。将类别特征、行为序列和任务标识符表示为令牌,并为每组引入少量枢纽令牌作为通信枢纽。通过高效的聚合-广播信息流实现交互:枢纽令牌通过交叉注意力跨组聚合全局上下文,再由轻量门控广播单元将优化后的上下文回传更新各类令牌。该设计支持宽度保持的堆叠,保留序列中的物品级信号,实现全过程任务引导交互,同时将交互成本从二次降低为线性。在公开基准与大规模工业数据集上的实验表明,INFNet持续优于强基线并展现良好扩展性。在商用在线广告系统中部署后,收入提升1.587%,点击率提升1.155%。
原文摘要 · Abstract (English)
Feature interaction is a core ingredient in ranking models for large-scale recommender systems, yet making it both expressive and efficiently scalable remains challenging. Exhaustive pairwise interaction is powerful but incurs quadratic complexity in the number of tokens/features, while many efficient alternatives rely on restrictive structures that limit information exchange. We further identify two common bottlenecks in practice: (1) early aggregation of behavior sequences compresses fine-grained signals, making it difficult for deeper layers to reuse item-level details; and (2) late fusion injects task signals only at the end, preventing task objectives from directly guiding the interaction process. To address these issues, we propose the Information Flow Network (INFNet), a lightweight architecture that enables scalable, task-aware feature interaction with linear complexity. INFNet represents categorical features, behavior sequences, and task identifiers as tokens, and introduces a small set of hub tokens for each group to serve as communication hubs. Interaction is realized through an efficient aggregate-and-broadcast information flow: hub tokens aggregate global context across groups via cross-attention, and a lightweight gated broadcast unit injects the refined context back to update the categorical, sequence, and task tokens. This design supports width-preserving stacking that preserves item-level signals in sequence and enables task-guided interaction throughout the network, while reducing interaction cost from quadratic to linear in the number of feature tokens. Experiments on a public benchmark and a large-scale industrial dataset demonstrate that INFNet consistently outperforms strong baselines and exhibits strong scaling behavior. In a commercial online advertising system, deploying INFNet improves revenue by +1.587% and click-through rate by +1.155%.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。