MinT让百万个大模型策略高效训练与部署,只传小量参数。
MinT: Managed Infrastructure for Training and Serving Millions of LLMs

- 用LoRA适配器替代完整模型,只传输少量增量参数。
- 在1万亿参数规模上实现训练与服务,单步耗时降低18.3倍。
- 支持百万级策略管理,适合大规模模型快速迭代场景。
我们提出MindLab Toolkit(MinT),一个面向低秩适配(LoRA)后训练与在线服务的托管基础设施系统。MinT针对多个策略由少数昂贵基础模型生成的场景,不将每个策略合并为完整检查点,而是保持基础模型常驻,仅在发布、更新、评估、服务和回滚等环节传递导出的LoRA适配器。该系统通过三方面扩展:纵向扩展将LoRA强化学习应用于前沿密集模型与混合专家(MoE)架构,包括MLA和DSA注意力路径,验证了超过1万亿参数的训练与服务;横向扩展仅传输导出的LoRA适配器,其大小可低于基础模型的1%(秩1设置下),在40亿参数稠密模型上使单步时间减少18.3倍,在300亿参数MoE模型上减少2.85倍;同时支持并发多策略GRPO,墙时缩短1.77倍与1.45倍,峰值内存不变。横向扩展将持久策略地址与计算资源解耦:张量并行部署支持百万级策略目录(单引擎扫描达10万),集群规模下可同时激活数千适配器,冷加载作为调度任务处理,打包的MoE LoRA张量使运行引擎加载速度提升8.5至8.7倍。因此,MinT可在共享1万亿级基础模型上,管理百万级LoRA策略目录,并对选定适配器版本进行训练与服务。
原文摘要 · Abstract (English)
We present MindLab Toolkit (MinT), a managed infrastructure system for Low-Rank Adaptation (LoRA) post-training and online serving. MinT targets a setting where many trained policies are produced over a small number of expensive base-model deployments. Instead of materializing each policy as a merged full checkpoint, MinT keeps the base model resident and moves exported LoRA adapter revisions through rollout, update, export, evaluation, serving, and rollback, hiding distributed training, serving, scheduling, and data movement behind a service interface. MinT scales this path along three axes. Scale Up extends LoRA RL to frontier-scale dense and MoE architectures, including MLA and DSA attention paths, with training and serving validated beyond 1T total parameters. Scale Down moves only the exported LoRA adapter, which can be under 1% of base-model size in rank-1 settings; adapter-only handoff reduces the measured step by 18.3x on a 4B dense model and 2.85x on a 30B MoE, while concurrent multi-policy GRPO shortens wall time by 1.77x and 1.45x without raising peak memory. Scale Out separates durable policy addressability from CPU/GPU working sets: a tensor-parallel deployment supports 10^6-scale addressable catalogs (measured single-engine sweeps through 100K) and thousand-adapter active waves at cluster scale, with cold loading treated as scheduled service work and packed MoE LoRA tensors improving live engine loading by 8.5-8.7x. MinT thus manages million-scale LoRA policy catalogs while training and serving selected adapter revisions over shared 1T-class base models.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。