Pangu Embedded用双系统思维实现高效推理,兼顾速度与深度。
Pangu Embedded: An Efficient Dual-system LLM Reasoner with Metacognition
- 采用两阶段训练,融合知识蒸馏与强化学习提升性能。
- 7B模型在多个基准上超越Qwen3-8B和GLM4-9B,响应快且推理准。
- 支持手动/自动切换快慢模式,适合对延迟敏感的部署场景。
本文提出Pangu Embedded,一种基于昇腾神经处理单元(NPU)的高效大语言模型推理框架,具备灵活的快速与深度思考能力。针对现有推理优化型大模型存在的高计算成本与高延迟问题,提出两阶段训练流程:第一阶段通过迭代式知识蒸馏与模型融合,有效聚合互补知识;第二阶段在昇腾集群上进行强化学习,采用容忍延迟的调度器,结合过时同步并行与优先级数据队列,并由多源自适应奖励系统(MARS)生成动态任务相关奖励信号,利用确定性指标与轻量级LLM评估器支持数学、编程与通用问题求解。最终构建双系统架构,赋予模型“快速”应对常规查询、“深度”处理复杂推理的能力,支持用户手动切换及自动复杂度感知模式选择,动态分配算力以平衡延迟与推理深度。在AIME 2024、GPQA和LiveCodeBench等基准测试中,7B参数的Pangu Embedded表现优于Qwen3-8B与GLM4-9B,实现单一模型内快速响应与顶尖推理质量,为可实用化大模型推理提供新方向。
原文摘要 · Abstract (English)
This work presents Pangu Embedded, an efficient Large Language Model (LLM) reasoner developed on Ascend Neural Processing Units (NPUs), featuring flexible fast and slow thinking capabilities. Pangu Embedded addresses the significant computational costs and inference latency challenges prevalent in existing reasoning-optimized LLMs. We propose a two-stage training framework for its construction. In Stage 1, the model is finetuned via an iterative distillation process, incorporating inter-iteration model merging to effectively aggregate complementary knowledge. This is followed by reinforcement learning on Ascend clusters, optimized by a latency-tolerant scheduler that combines stale synchronous parallelism with prioritized data queues. The RL process is guided by a Multi-source Adaptive Reward System (MARS), which generates dynamic, task-specific reward signals using deterministic metrics and lightweight LLM evaluators for mathematics, coding, and general problem-solving tasks. Stage 2 introduces a dual-system framework, endowing Pangu Embedded with a "fast" mode for routine queries and a deeper "slow" mode for complex inference. This framework offers both manual mode switching for user control and an automatic, complexity-aware mode selection mechanism that dynamically allocates computational resources to balance latency and reasoning depth. Experimental results on benchmarks including AIME 2024, GPQA, and LiveCodeBench demonstrate that Pangu Embedded with 7B parameters, outperforms similar-size models like Qwen3-8B and GLM4-9B. It delivers rapid responses and state-of-the-art reasoning quality within a single, unified model architecture, highlighting a promising direction for developing powerful yet practically deployable LLM reasoners.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。