arXiv:2603.00416cs.IRcs.AI2026-03被引 1

用新优化器MuonRec替代Adam,显著提升推荐系统训练效率与效果

MuonRec: Shifting the Optimizer Paradigm Beyond Adam in Scalable Generative Recommendation

  • 采用Newton-Schulz迭代实现权重矩阵正交化动量更新
  • 训练步数减少32.4%,NDCG@10平均提升12.6%
  • 特别适合大规模生成式推荐模型,开源可复现

推荐系统正趋向规模化,依赖更大架构和更多交互数据以提升个性化。然而,尽管优化器在训练中起关键作用,现代推荐系统几乎都默认使用Adam/AdamW,缺乏对其是否最优的深入评估。本文重新审视可扩展推荐系统的优化器设计,提出首个将近期提出的Muon优化器引入推荐系统训练的框架MuonRec。Muon通过Newton-Schulz迭代对二维权重矩阵执行正交化动量更新,促进多样化的更新方向,提升优化效率。我们构建了推荐模型的开源训练方案,并在传统序列推荐器与现代生成式推荐器上进行评估。大量实验表明,MuonRec平均减少32.4%的收敛训练步数,同时提升最终排序质量;在所有设置下NDCG@10平均提升12.6%,生成式推荐模型中尤为显著。结果持续优于强基线Adam/AdamW,表明Muon有望成为推荐系统训练的新标准。代码已开源。

原文摘要 · Abstract (English)

Recommender systems (RecSys) are increasingly emphasizing scaling, leveraging larger architectures and more interaction data to improve personalization. Yet, despite the optimizer's pivotal role in training, modern RecSys pipelines almost universally default to Adam/AdamW, with limited scrutiny of whether these choices are truly optimal for recommendation. In this work, we revisit optimizer design for scalable recommendation and introduce MuonRec, the first framework that brings the recently proposed Muon optimizer to RecSys training. Muon performs orthogonalized momentum updates for 2D weight matrices via Newton-Schulz iteration, promoting diverse update directions and improving optimization efficiency. We develop an open-source training recipe for recommendation models and evaluate it across both traditional sequential recommenders and modern generative recommenders. Extensive experiments demonstrate that MuonRec reduces converged training steps by an average of 32.4\% while simultaneously improving final ranking quality. Specifically, MuonRec yields consistent relative gains in NDCG@10, averaging 12.6\% across all settings, with particularly pronounced improvements in generative recommendation models. These results consistently outperform strong Adam/AdamW baselines, positioning Muon as a promising new optimizer standard for RecSys training. Our code is available.

推荐系统优化器生成式推荐高效训练

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。