arXiv:2604.08011cs.IR2026-04中稿 · as a full paper at…被引 2

提出显式稀疏架构,让推荐模型更高效处理海量稀疏数据。

Beyond Dense Connectivity: Explicit Sparsity for Scalable Recommendation

论文配图:Beyond Dense Connectivity: Explicit Sparsity for Scalable Recommendation
图 1 · 摘自论文原文
  • 用多视角过滤-融合机制,显式引入稀疏性提升效率
  • 在三个公开数据集和亿级工业数据上超越现有方法
  • 动态稀疏机制可随规模持续提升性能,适合大规模推荐场景

近年来大模型的扩展推动推荐系统增加模型深度与容量以更好利用海量行为数据。然而,推荐输入具有高维且极度稀疏的特点,单纯扩展密集型骨干网络(如深层MLP)常导致收益递减甚至性能下降。对工业点击率模型的分析发现存在隐式连接稀疏现象:多数学习到的连接权重趋近于零,仅少数保持显著。这表明密集连接与稀疏推荐数据间存在结构不匹配;密集架构迫使模型处理大量低效连接,反而成为有效模式建模的主要瓶颈。为此,我们提出SSR(Explicit Sparsity for Scalable Recommendation),将稀疏性显式融入架构设计。SSR采用多视图“过滤-融合”机制,将输入分解为并行视图进行维度级稀疏过滤,再进行密集融合。具体通过两种策略实现稀疏性:静态随机滤波器(固定维度子集实现高效结构稀疏),以及可微分的迭代竞争稀疏(ICS),模拟生物竞争机制自适应保留高响应维度。在三个公开数据集及来自全球电商平台AliExpress的百亿级工业数据集上的实验表明,SSR在相似计算预算下优于当前最优基线。关键的是,SSR展现出卓越可扩展性,在密集模型趋于饱和时仍能持续提升性能。

原文摘要 · Abstract (English)

Recent progress in scaling large models has motivated recommender systems to increase model depth and capacity to better leverage massive behavioral data. However, recommendation inputs are high-dimensional and extremely sparse, and simply scaling dense backbones (e.g., deep MLPs) often yields diminishing returns or even performance degradation. Our analysis of industrial CTR models reveals a phenomenon of implicit connection sparsity: most learned connection weights tend towards zero, while only a small fraction remain prominent. This indicates a structural mismatch between dense connectivity and sparse recommendation data; by compelling the model to process vast low-utility connections instead of valid signals, the dense architecture itself becomes the primary bottleneck to effective pattern modeling. We propose SSR (Explicit Sparsity for Scalable Recommendation), a framework that incorporates sparsity explicitly into the architecture. SSR employs a multi-view "filter-then-fuse" mechanism, decomposing inputs into parallel views for dimension-level sparse filtering followed by dense fusion. Specifically, we realize the sparsity via two strategies: a Static Random Filter that achieves efficient structural sparsity via fixed dimension subsets, and Iterative Competitive Sparse (ICS), a differentiable dynamic mechanism that employs bio-inspired competition to adaptively retain high-response dimensions. Experiments on three public datasets and a billion-scale industrial dataset from AliExpress (a global e-commerce platform) show that SSR outperforms state-of-the-art baselines under similar budgets. Crucially, SSR exhibits superior scalability, delivering continuous performance gains where dense models saturate.

推荐系统稀疏性可扩展性深度学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。