让多模态模型像人一样分步思考,复杂问题慢推理,简单问题快判断。
AtomThink: Multimodal Slow Thinking with Atomic Step Reasoning
- 用原子化步骤构建灵活推理链,避免过度思考。
- 在MathVista和MathVerse上平均准确率提升超10%。
- 适合需要精准推理的多模态任务研究者使用。
本文针对多模态推理难题,将‘慢思考’理念引入多模态大语言模型(MLLMs)。提出自结构思维链(SCoT)新范式,由最小语义原子步骤构成。不同于依赖结构模板或自由形式的方法,该方法能为不同复杂度任务生成灵活推理链,同时缓解简单任务的过度推理现象。设计了AtomThink框架,包含四大模块:(i)生成高质量多模态推理路径的数据引擎;(ii)序列化推理数据的监督微调(SFT)流程;(iii)策略引导的多轮推理机制;(iv)评估单步利用率的原子能力指标。大量实验表明,AtomThink显著提升基线MLLM性能,在MathVista和MathVerse上平均准确率提升超过10%。相比当前最优结构化思维链方法,本方法不仅精度更高,还实现数据利用率提升5倍、推理效率提高85.3%。代码已公开于https://github.com/Kun-Xiang/AtomThink。
原文摘要 · Abstract (English)
In this paper, we address the challenging task of multimodal reasoning by incorporating the notion of ``slow thinking'' into multimodal large language models (MLLMs). Our core idea is that models can learn to adaptively use different levels of reasoning to tackle questions of varying complexity. We propose a novel paradigm of Self-structured Chain of Thought (SCoT), which consists of minimal semantic atomic steps. Unlike existing methods that rely on structured templates or free-form paradigms, our method not only generates flexible CoT structures for various complex tasks but also mitigates the phenomenon of overthinking for easier tasks. To introduce structured reasoning into visual cognition, we design a novel AtomThink framework with four key modules: (i) a data engine to generate high-quality multimodal reasoning paths; (ii) a supervised fine-tuning (SFT) process with serialized inference data; (iii) a policy-guided multi-turn inference method; and (iv) an atomic capability metric to evaluate the single-step utilization rate. Extensive experiments demonstrate that the proposed AtomThink significantly improves the performance of baseline MLLMs, achieving more than 10\% average accuracy gains on MathVista and MathVerse. Compared to state-of-the-art structured CoT approaches, our method not only achieves higher accuracy but also improves data utilization by 5 $\times$ and boosts inference efficiency by 85.3\%. Our code is publicly available at https://github.com/Kun-Xiang/AtomThink.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。