arXiv:2605.11629cs.CL2026-05

用180万条高质量多模态推理数据,让小模型也能具备强推理能力。

OmniThoughtVis: A Scalable Distillation Pipeline for Deployable Multimodal Reasoning Models

论文配图:OmniThoughtVis: A Scalable Distillation Pipeline for Deployable Multimodal Reasoning Models
图 1 · 摘自论文原文
  • 构建可扩展的多模态推理数据流水线,生成结构化思维链数据。
  • 1.8万条数据训练后,4B模型在数学和知识题上提升超5.6分。
  • 适合追求低延迟部署且需强推理的小型多模态模型开发者。

近期多模态大语言模型(MLLMs)在视觉-语言任务中展现出强大的链式思维(CoT)推理能力,但其直接部署受限于延迟和资源开销。实际应用中更倾向使用小型MLLM进行在线服务,但其推理性能受限于缺乏大规模、高质量的多模态CoT监督数据。本文提出OmniThoughtVis,一个可扩展的数据筛选与知识蒸馏流水线,将高性能教师模型的多模态推理能力迁移到更小、适合部署的MLLMs。从多样开源数据池出发,生成结构化的思维链轨迹,并联合标注推理难度、答案质量与语义任务标签。通过规则过滤、难度感知选择及标签多样性采样,构建出包含180万样本的精选数据集,支持可控子集构建。我们利用OmniThoughtVis对Qwen3-VL模型从2B到8B参数进行蒸馏,在九个多模态推理基准上评估。结果表明,不同规模模型均取得一致提升,其中4B模型在MathVerse上最高提升16.8分,在MMMU-Pro上提升5.6分。值得注意的是,该4B蒸馏模型在多个任务上达到甚至超越未蒸馏的8B基线,凸显了可扩展推理蒸馏对部署友好型模型的实际价值。

原文摘要 · Abstract (English)

Recent multimodal large language models (MLLMs) have shown strong chain-of-thought (CoT) reasoning ability on vision-language tasks, but their direct deployment in real-world systems is often limited by latency and resource constraints. In practice, smaller MLLMs are preferred for online serving, yet their reasoning performance is bottlenecked by the lack of large-scale, high-quality multimodal CoT supervision. In this paper, we present OmniThoughtVis, a scalable data curation and distillation pipeline for transferring multimodal reasoning capabilities from high-capacity teacher models to smaller, deployment-oriented MLLMs. Starting from a diverse open-source seed pool, our pipeline generates structured CoT traces and performs joint annotation of reasoning difficulty, answer quality, and semantic task tags. To maintain data quality at scale, we combine rule-based filtering, difficulty-aware selection, and tag-based diversity sampling, resulting in a curated corpus of 1.8M samples that supports controllable subset construction for downstream training. We use OmniThoughtVis to distill Qwen3-VL models from 2B to 8B parameters and evaluate them on nine multimodal reasoning benchmarks. The resulting distilled models show consistent gains across model scales, including improvements of up to +16.8 points on MathVerse and +5.6 points on MMMU-Pro for the 4B model. Notably, the distilled 4B model matches or surpasses the undistilled 8B baseline on several tasks, highlighting the practical value of scalable reasoning distillation for deployment-oriented MLLMs.

多模态知识蒸馏推理增强模型压缩

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。