arXiv:2507.05934cs.AI2025-07被引 5

30亿参数的多模态大模型,支持思考与非思考模式,适合手机等设备部署。

BlueLM-2.5-3B Technical Report

  • 通过混合强化学习和数据重采样训练,实现小模型强能力
  • 思考模式下性能接近40亿参数模型,非思考模式胜过同类30亿模型
  • 训练数据量少于同类模型,适合资源受限的边缘设备

我们提出 BlueLM-2.5-3B,一个专为边缘设备部署设计的紧凑统一多模态大语言模型,兼具强大通用能力与推理能力。据我们所知,这是首个支持思考与非思考模式的30亿参数级多模态大模型,并可显式控制思考令牌预算。模型通过多样化数据整理、关键数据重采样、混合异构强化学习及高性能训练基础设施构建。在仅29亿参数下,实现卓越的多模态表现,同时保持与纯文本任务竞争性。在思考模式下,其在纯文本基准上表现接近 Qwen3-4B,多模态评估平均仅比 Kimi-VL-A3B-16B 低约5%;在非思考模式下,多数多模态基准优于 Qwen2.5-VL-3B。此外,该模型展现极强的数据效率,所有性能均以远少于 Qwen2.5-VL-3B 与 Qwen3-4B 的训练数据量达成。我们希望本工作推动高性能本地化多模态大模型发展,并为研究社区提供有益参考。

原文摘要 · Abstract (English)

We present BlueLM-2.5-3B, a compact and unified dense Multimodal Large Language Model (MLLM) designed for efficient edge-device deployment, offering strong general-purpose and reasoning capabilities. To the best of our knowledge, this is the first 3B-scale MLLM to support both thinking and non-thinking modes, while also enabling explicit control over thinking token budget. BlueLM-2.5-3B is developed through diversified data curation, key data resampling, hybrid heterogeneous reinforcement learning, and a high-performance training infrastructure. Our model achieves superior multimodal capacity while preserving competitive pure-text performance with only 2.9 billion parameters. We conduct comprehensive evaluations across a broad range of multimodal and text-only benchmarks. In thinking mode, BlueLM-2.5-3B achieves comparable performance to Qwen3-4B on text-only benchmarks, and trails the larger Kimi-VL-A3B-16B by only about 5% on average across multimodal evaluations. In non-thinking mode, it outperforms Qwen2.5-VL-3B on the majority of multimodal benchmarks. Additionally, BlueLM-2.5-3B exhibits exceptional data efficiency. All of the aforementioned performance is achieved with substantially less total training data than Qwen2.5-VL-3B and Qwen3-4B. We hope our work contributes to the advancement of high-performance, on-device MLLMs and provides meaningful insights to the research community.

多模态大模型边缘部署小模型大能力思考模式

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。