arXiv:2505.00949cs.CLcs.AI2025-05被引 96

Llama-Nemotron系列模型以高效推理和开源授权,实现媲美顶尖模型的思维能力。

Llama-Nemotron: Efficient Reasoning Models

  • 基于架构搜索与知识蒸馏,优化推理效率并提升性能。
  • 在相同任务下,推理吞吐量优于同类模型,内存效率更高。
  • 支持推理模式动态切换,适合企业级应用与开放研究。

我们推出了Llama-Nemotron系列模型,这是一组开源的异构推理模型,具备卓越的推理能力、高效的推理速度和适用于企业使用的开放许可。该系列包含三种规模:Nano(8B)、Super(49B)和Ultra(253B),在性能上可与DeepSeek-R1等前沿推理模型竞争,同时提供更高的推理吞吐量和更低的内存占用。本文介绍了这些模型的训练流程:从Llama 3模型出发,通过神经架构搜索实现加速推理,结合知识蒸馏与持续预训练,再经过聚焦推理的后训练阶段,包括监督微调和大规模强化学习。Llama-Nemotron是首个支持动态推理切换的开源模型,用户可在推理过程中自由切换标准聊天与推理模式。为促进开放研究与模型开发,我们发布了:1. 三款推理模型——LN-Nano、LN-Super、LN-Ultra,采用NVIDIA开放模型许可协议;2. 完整的后训练数据集:Llama-Nemotron-Post-Training-Dataset;3. 训练代码库:NeMo、NeMo-Aligner 和 Megatron-LM。

原文摘要 · Abstract (English)

We introduce the Llama-Nemotron series of models, an open family of heterogeneous reasoning models that deliver exceptional reasoning capabilities, inference efficiency, and an open license for enterprise use. The family comes in three sizes -- Nano (8B), Super (49B), and Ultra (253B) -- and performs competitively with state-of-the-art reasoning models such as DeepSeek-R1 while offering superior inference throughput and memory efficiency. In this report, we discuss the training procedure for these models, which entails using neural architecture search from Llama 3 models for accelerated inference, knowledge distillation, and continued pretraining, followed by a reasoning-focused post-training stage consisting of two main parts: supervised fine-tuning and large scale reinforcement learning. Llama-Nemotron models are the first open-source models to support a dynamic reasoning toggle, allowing users to switch between standard chat and reasoning modes during inference. To further support open research and facilitate model development, we provide the following resources: 1. We release the Llama-Nemotron reasoning models -- LN-Nano, LN-Super, and LN-Ultra -- under the commercially permissive NVIDIA Open Model License Agreement. 2. We release the complete post-training dataset: Llama-Nemotron-Post-Training-Dataset. 3. We also release our training codebases: NeMo, NeMo-Aligner, and Megatron-LM.

推理模型开源模型高效推理动态切换

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。