让大模型自己决定如何并行生成,速度翻倍且不丢性能
Multiverse: Your Language Models Secretly Decide How to Parallelize and Merge Generation
- 用分治三阶段机制让模型自动拆任务、并行算、合并结果
- 3小时微调后320亿参数模型性能媲美顶尖自回归模型
- 适合追求推理效率、想快速部署并行生成的开发者
自回归大语言模型常在生成中隐含并行性。受此启发,我们提出Multiverse,一种原生支持并行生成的新模型。它内建MapReduce范式,分三步:(i) Map阶段自适应任务分解,(ii) Process阶段并行执行子任务,(iii) Reduce阶段无损合成结果。我们构建了真实世界的Multiverse推理模型,实现数据、算法、系统的协同设计。数据方面,开发Multiverse Curator自动化管道,将顺序推理链转为结构化训练数据,避免人工标注。算法上,设计Multiverse Attention,分离并行推理步骤同时兼容因果注意力,便于高效训练。系统层面,实现Multiverse Engine支持并行推理,内置解释器可动态切换串行与并行生成模式。仅用1000个样本进行3小时微调后,Multiverse-32B成为唯一开源非自回归模型,在同规模下性能媲美领先自回归模型,AIME24和25得分分别为54%和46%。预算控制实验显示,其平均性能优于自回归模型1.87%,相同上下文长度下,效率提升达2倍。我们已开源整个Multiverse生态,包括数据、模型权重、引擎、完整数据构建提示及训练评估方案。
原文摘要 · Abstract (English)
Autoregressive Large Language Models (AR-LLMs) frequently exhibit implicit parallelism in sequential generation. Inspired by this, we introduce Multiverse, a new generative model that enables natively parallel generation. Multiverse internalizes a MapReduce paradigm, generating automatically through three stages: (i) a Map stage for adaptive task decomposition, (ii) a Process stage for parallel subtask execution, and (iii) a Reduce stage for lossless result synthesis. Next, we build a real-world Multiverse reasoning model with co-design of data, algorithm, and system, enabling rapid and seamless transfer from frontier AR-LLMs. For data creation, we develop Multiverse Curator, an automated LLM-assisted pipeline that transforms sequential reasoning chains into structured training data, avoiding costly human annotations. Algorithmically, we design Multiverse Attention to separate parallel reasoning steps while keeping compatibility with causal attention for efficient training. Systematically, we implement Multiverse Engine to support parallel inference. It features a dedicated interpreter that dynamically switches between sequential and parallel generation, triggered directly by the model. After a 3-hour fine-tuning with 1K examples, our Multiverse-32B stands as the only open-sourced non-AR model achieving performance on par with leading AR-LLMs of the same scale, evidenced by AIME24 & 25 scores of 54% and 46%, respectively. Moreover, our budget control experiments show that Multiverse-32B exhibits superior scaling, outperforming AR-LLMs by 1.87% on average using the same context length. Such scaling further leads to practical efficiency gains, achieving up to 2x speedup across varying batch sizes. We have open-sourced the entire Multiverse ecosystem, including data, model weights, engine, as well as complete data curation prompts and detailed training and evaluation recipes.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。