arXiv:2605.27450cs.IRcs.LG2026-05

通过分块分解,让推荐系统省下大量重复计算。

Context Features Are Cheap: Rank-Aware Decomposition for Efficient Feature Interaction in Recommender Systems

  • 将上下文特征计算从每候选一次改为每请求一次,节省冗余运算。
  • 在真实系统中提升吞吐量87.5%,峰值节点数减少47%。
  • 适用于主流推荐模型,且不改变原有结构,适合工业部署。

现代工业级推荐系统使用深度排序模型对同一用户和上下文下的N个候选进行打分。标准实现会在前向传播早期广播上下文特征,导致每次请求中上下文相关计算重复执行N次。本文提出一种基于秩分区的通用分解方法,适用于主流交互机制——因子分解机(FM)成对乘积、深度交叉网络(DCNv2)交叉层、自注意力和全连接投影层。该方法基于单一代数原理:对秩分区输入的任意线性或双线性操作均可精确分解为块形式,将仅含上下文的计算从每候选一次变为每请求一次,且与原模型完全等价。闭式分析与受控消融验证了节省效果随上下文特征数量的平方增长。应用于无架构改动的生产级DLRM风格排序器后,每节点吞吐量提升87.5%(峰值节点数减少47%),预测结果不变。该等价分解仅适用于交叉网络和自注意力的第一层,因后续层会混合秩。为扩展跨深度的收益,我们进一步提出rDCN,是DCNv2的变体,保持秩一致性,训练噪声范围内精度与原版相当,总浮点运算量减少67%;并简要设计了自注意力的类似变体。

原文摘要 · Abstract (English)

Modern industrial recommender systems use a deep ranking model to score N candidates against the same user and context features. Standard implementations broadcast context features early in the forward pass, redundantly computing context-only operations N times per request. We present a rank-aware decomposition applicable to the dominant interaction mechanisms in modern recommender architectures-Factorization Machine (FM) pairwise products, Deep Cross Network (DCNv2) cross layers, self-attention, and fully connected (FC) projection layers-built on a single algebraic principle: any linear or bilinear operation over a rank-partitioned input admits an exact block decomposition that moves context-only computation from once-per-candidate to once-per-request, identity-equivalent to the original model. Closed-form analysis and controlled ablation verify that savings scale quadratically with the number of context features. Applied to a production DLRM-style ranker without any architectural change, the decomposition increases per-pod throughput by 87.5% (a 47% reduction in peak pod count) at identical model predictions. The identity-equivalent decomposition applies only at the first layer of cross networks and self-attention, since each layer mixes ranks in its output. To extend savings across depth, we further introduce rDCN, an architectural variant of DCNv2 that maintains rank discipline across depth and matches DCNv2 accuracy within training noise at 67% fewer total FLOPs, and sketch an analogous architectural variant for self-attention.

推荐系统高效计算模型优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。