arXiv:2605.07182cs.LG2026-05被引 2

一训练生成多个大小模型,动态分配算力,显著提升推理效率与精度。

Star Elastic: Many-in-One Reasoning LLMs with Efficient Budget Control

论文配图:Star Elastic: Many-in-One Reasoning LLMs with Efficient Budget Control
图 1 · 摘自论文原文
  • 通过嵌套子模型与端到端路由,单次训练实现多尺寸模型生成。
  • 生成23B、12B模型,相比独立训练节省360倍成本,精度更高且延迟降低1.9倍。
  • 支持动态选择不同子模型用于思考与回答阶段,适合资源受限场景部署。

训练大型语言模型家族成本高昂且低效,需对每个模型单独训练。本文提出Star Elastic,一种新型后训练方法,仅用一次训练即可在父模型上添加N个嵌套子模型(实现N倍成本节约)。该方法突破静态架构限制,实现弹性预算控制,使推理阶段可按思维与回答不同阶段动态切换子模型。支持沿SSM、嵌入通道、MoE和前馈网络轴的嵌套,通过可训练路由器学习子模型,并采用课程式知识蒸馏。基于Nemotron Elastic框架,在NVIDIA Nemotron Nano模型上应用,从v3版(30B/3.6A)生成23B(2.8A)和12B(2.0A)版本,使用160B训练标记。所有嵌套模型性能匹配或优于同规模独立训练基线,较从头预训练降低360倍成本,较现有压缩技术降低7倍。弹性预算使准确率-延迟权衡更优,最高提升16%准确率,延迟降低1.9倍。进一步通过量化感知蒸馏(QAD)扩展至NVFP4和FP8量化版本,保持零样本切片能力,同时减小部署开销。

原文摘要 · Abstract (English)

Training a family of large language models (LLMs), either from scratch or via iterative compression, is prohibitively expensive and inefficient, requiring separate training runs for each model in the family. In this paper, we introduce Star Elastic, a novel LLM post-training method that adds N nested submodels to a given parent reasoning model using the compute of one run (N-fold savings) via a single post-training job. Beyond reducing training costs, Star Elastic also addresses a fundamental limitation of efficient reasoning: the rigidity of static architectures, which forces the allocation of constant resources regardless of token difficulty. By unlocking elastic budget control, Star Elastic enables a novel inference scheme that uses different submodels for each reasoning phase (thinking and answering). Star Elastic supports (1) nesting along the SSM, embedding channel, MoE, and FFN axes, (2) learning nested submodels via an end-to-end trainable router, and (3) curriculum-based knowledge distillation. Building on the Nemotron Elastic framework, we apply Star Elastic to the NVIDIA Nemotron Nano models, with a particular focus on hybrid Mixture-of-Experts (MoE) architectures: from Nemotron Nano v3 (30B/3.6A), we generate 23B (2.8A) and 12B (2.0A) variants with 160B training tokens. All nested models match or outperform independently trained baselines of comparable size and achieve a 360x reduction versus pretraining from scratch and a 7x reduction over state-of-the-art compression. Crucially, elastic budget control advances the accuracy-latency Pareto frontier, achieving up to 16% higher accuracy and 1.9x lower latency via dynamic per-phase model selection. We further extend Star Elastic to quantized regimes via Quantization-Aware Distillation (QAD), producing nested NVFP4 and FP8 elastic checkpoints that preserve zero-shot slicing while delivering smaller deployment footprints.

大模型压缩弹性推理MoE架构高效训练

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。