arXiv:2602.09194cs.LG2026-02

ML-DCN通过低秩交叉+动态掩码,实现广告点击率预测的高效扩展。

ML-DCN: Masked Low-Rank Deep Crossing Network Towards Scalable Ads Click-through Rate Prediction at Pinterest

  • 引入实例相关掩码的低秩交叉层,按需激活重要特征交互方向。
  • 在相同计算量下,AUC优于DCNv2和MaskNet,且随算力增加性能提升更显著。
  • 已上线生产环境,推理成本无增长,适合大规模推荐系统部署。

深度学习推荐系统依赖特征交互模块来建模稀疏类别特征与密集特征间的复杂用户-物品关系。在大规模广告排序中,提升模型容量是改善预测性能与商业指标的有效路径,但线上服务预算对延迟和浮点运算量(FLOPs)有严格限制,形成核心矛盾:交互模块需在增加计算资源时有效扩展,同时保持推理效率。本文研究在固定服务预算下如何扩展特征交互模块。实验发现,尽管广泛应用于工业界,但简单放大DCNv2和MaskNet的效果迅速衰减。为此,提出ML-DCN,将实例条件掩码集成到低秩交叉层中,实现每样本对关键交互方向的选择与增强,同时保持高效计算。该架构融合了DCNv2与MaskNet的优势,在增加算力时可高效扩展,达到当前最优性能。在大型内部Pinterest广告数据集上的实验表明,ML-DCN在匹配FLOPs条件下比DCNv2、MaskNet及近期扩展型方法获得更高AUC,且随算力提升表现更优,展现出更强的AUC-FLOPs权衡能力。最终,线上A/B测试验证了其在关键广告指标(包括点击率和点击质量)上具有统计显著提升,且已部署于生产系统,推理成本不变。

原文摘要 · Abstract (English)

Deep learning recommendation systems rely on feature interaction modules to model complex user-item relationships across sparse categorical and dense features. In large-scale ad ranking, increasing model capacity is a promising path to improving both predictive performance and business outcomes, yet production serving budgets impose strict constraints on latency and FLOPs. This creates a central tension: we want interaction modules that both scale effectively with additional compute and remain compute-efficient at serving time. In this work, we study how to scale feature interaction modules under a fixed serving budget. We find that naively scaling DCNv2 and MaskNet, despite their widespread adoption in industry, yields rapidly diminishing offline gains in the Pinterest ads ranking system. To overcome aforementioned limitations, we propose ML-DCN, an interaction module that integrates an instance-conditioned mask into a low-rank crossing layer, enabling per-example selection and amplification of salient interaction directions while maintaining efficient computation. This novel architecture combines the strengths of DCNv2 and MaskNet, scales efficiently with increased compute, and achieves state-of-the-art performance. Experiments on a large internal Pinterest ads dataset show that ML-DCN achieves higher AUC than DCNv2, MaskNet, and recent scaling-oriented alternatives at matched FLOPs, and it scales more favorably overall as compute increases, exhibiting a stronger AUC-FLOPs trade-off. Finally, online A/B tests demonstrate statistically significant improvements in key ads metrics (including CTR and click-quality measures) and ML-DCN has been deployed in the production system with neutral serving cost.

点击率预测特征交互低秩网络工业部署

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。