开源可复现的多模态推理训练方案,提升模型表现11.6%
OpenMMReasoner: Pushing the Frontiers for Multimodal Reasoning with an Open and General Recipe
- 分两阶段训练:先用87万样本冷启动微调,再用74万样本强化学习
- 在9个基准上比Qwen2.5-VL-7B-Instruct高出11.6%
- 全程开源数据与代码,推动可复现研究
大型推理模型的发展激发了将此类能力拓展至多模态领域的兴趣。然而,尽管视觉推理取得显著进展,透明且可复现的数据构建与训练策略仍严重阻碍研究规模化。本文提出OpenMMReasoner,一种全透明的两阶段多模态推理训练方案,包含监督微调(SFT)与强化学习(RL)。SFT阶段构建了87.4万样本的冷启动数据集,经逐步严格验证,奠定推理能力基础;后续RL阶段利用跨多个领域的74万样本数据集进一步优化并稳定推理性能,实现更高效稳健的学习过程。大量实验表明,该训练方案不仅超越强基线,更凸显数据质量与训练设计对多模态推理性能的关键影响。值得注意的是,该方法在9个多模态推理基准上相较Qwen2.5-VL-7B-Instruct提升11.6%,为未来大规模多模态推理研究提供坚实实证基础。所有代码、流程与数据已开源:https://github.com/EvolvingLMMs-Lab/OpenMMReasoner。
原文摘要 · Abstract (English)
Recent advancements in large reasoning models have fueled growing interest in extending such capabilities to multimodal domains. However, despite notable progress in visual reasoning, the lack of transparent and reproducible data curation and training strategies remains a major barrier to scalable research. In this work, we introduce OpenMMReasoner, a fully transparent two-stage recipe for multimodal reasoning spanning supervised fine-tuning (SFT) and reinforcement learning (RL). In the SFT stage, we construct an 874K-sample cold-start dataset with rigorous step-by-step validation, providing a strong foundation for reasoning capabilities. The subsequent RL stage leverages a 74K-sample dataset across diverse domains to further sharpen and stabilize these abilities, resulting in a more robust and efficient learning process. Extensive evaluations demonstrate that our training recipe not only surpasses strong baselines but also highlights the critical role of data quality and training design in shaping multimodal reasoning performance. Notably, our method achieves a 11.6% improvement over the Qwen2.5-VL-7B-Instruct baseline across nine multimodal reasoning benchmarks, establishing a solid empirical foundation for future large-scale multimodal reasoning research. We open-sourced all our codes, pipeline, and data at https://github.com/EvolvingLMMs-Lab/OpenMMReasoner.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。