arXiv:2505.09388cs.CL2025-05被引 7.7k

Qwen3统一推理与对话模式,支持动态切换并提升多语言能力。

Qwen3 Technical Report

  • 融合思考与非思考模式,无需切换模型即可应对复杂任务
  • 支持0.6至2350亿参数规模,推理时可动态分配计算资源
  • 多语言支持扩展至119种,性能媲美大模型且开源可用

本文介绍 Qwen3,Qwen 模型系列的最新版本。Qwen3 包含一系列大语言模型(LLMs),旨在提升性能、效率和多语言能力。该系列涵盖密集架构与混合专家(MoE)架构,参数量从 0.6 到 2350 亿不等。关键创新在于将思考模式(用于复杂多步推理)与非思考模式(用于快速上下文响应)整合到统一框架中,无需在聊天优化模型(如 GPT-4o)与专用推理模型(如 QwQ-32B)间切换,并可根据用户查询或对话模板实现动态模式切换。同时引入思考预算机制,允许用户在推理过程中自适应分配计算资源,从而根据任务复杂度平衡延迟与性能。此外,通过利用旗舰模型的知识,显著降低小规模模型的构建成本,同时保持高度竞争力。实证评估显示,Qwen3 在代码生成、数学推理、智能体任务等多样化基准上均达到顶尖水平,表现可媲美更大规模的 MoE 模型及专有模型。相比前代 Qwen2.5,Qwen3 的多语言支持从 29 种扩展至 119 种语言和方言,显著增强跨语言理解与生成能力。为促进可复现性与社区研发,所有 Qwen3 模型均以 Apache 2.0 开源协议发布。

原文摘要 · Abstract (English)

In this work, we present Qwen3, the latest version of the Qwen model family. Qwen3 comprises a series of large language models (LLMs) designed to advance performance, efficiency, and multilingual capabilities. The Qwen3 series includes models of both dense and Mixture-of-Expert (MoE) architectures, with parameter scales ranging from 0.6 to 235 billion. A key innovation in Qwen3 is the integration of thinking mode (for complex, multi-step reasoning) and non-thinking mode (for rapid, context-driven responses) into a unified framework. This eliminates the need to switch between different models--such as chat-optimized models (e.g., GPT-4o) and dedicated reasoning models (e.g., QwQ-32B)--and enables dynamic mode switching based on user queries or chat templates. Meanwhile, Qwen3 introduces a thinking budget mechanism, allowing users to allocate computational resources adaptively during inference, thereby balancing latency and performance based on task complexity. Moreover, by leveraging the knowledge from the flagship models, we significantly reduce the computational resources required to build smaller-scale models, while ensuring their highly competitive performance. Empirical evaluations demonstrate that Qwen3 achieves state-of-the-art results across diverse benchmarks, including tasks in code generation, mathematical reasoning, agent tasks, etc., competitive against larger MoE models and proprietary models. Compared to its predecessor Qwen2.5, Qwen3 expands multilingual support from 29 to 119 languages and dialects, enhancing global accessibility through improved cross-lingual understanding and generation capabilities. To facilitate reproducibility and community-driven research and development, all Qwen3 models are publicly accessible under Apache 2.0.

大模型多语言推理优化开源

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。