arXiv:2507.16518cs.CVcs.CL2025-07被引 9

让数学推理模型和数据一起进化,自动提升能力。

SyncLoop: A Multimodal Dual-Loop Framework for Self-Improving Mathematical Reasoning

  • 双循环协同进化:图文数据与模型同步优化。
  • 在多个数学推理基准上持续提升性能,效果显著。
  • 适合自研多模态推理系统的研究者参考。

近期多模态大模型在数学推理方面表现优异,但进一步提升需高质量、复杂度可控的视觉-语言数据集,这类数据成本高且难以扩展。现有自我改进模型虽可行,但仍存在两大问题:(i) 视觉与文本数据分别增强,导致复杂度不匹配(如简化图形配冗余描述);(ii) 数据与模型演化分离,模型常面对难度不匹配的任务。为此,我们提出 C2-Evo,一个自动闭环的自进化框架,联合优化训练数据与模型能力。给定基础数据集与基础模型,C2-Evo 通过跨模态数据演化环生成融合结构化文本子问题与迭代式几何图示的复杂多模态题目,并通过数据-模型演化环根据基础模型表现自适应选择生成题目,交替进行监督微调与强化学习。该方法持续精炼模型与数据,在多个数学推理基准上实现显著性能提升。代码、模型与数据集将公开。

原文摘要 · Abstract (English)

Recent advances in multimodal large language models (MLLMs) have shown impressive reasoning capabilities. However, further enhancing existing MLLMs necessitates high-quality vision-language datasets with carefully curated task complexities, which are both costly and challenging to scale. Although recent self-improving models that iteratively refine themselves offer a feasible solution, they still suffer from two core challenges: (i) most existing methods augment visual or textual data separately, resulting in discrepancies in data complexity (e.g., over-simplified diagrams paired with redundant textual descriptions); and (ii) the evolution of data and models is also separated, leading to scenarios where models are exposed to tasks with mismatched difficulty levels. To address these issues, we propose C2-Evo, an automatic, closed-loop self-improving framework that jointly evolves both training data and model capabilities. Specifically, given a base dataset and a base model, C2-Evo enhances them by a cross-modal data evolution loop and a data-model evolution loop. The former loop expands the base dataset by generating complex multimodal problems that combine structured textual sub-problems with iteratively specified geometric diagrams, while the latter loop adaptively selects the generated problems based on the performance of the base model, to conduct supervised fine-tuning and reinforcement learning alternately. Consequently, our method continuously refines its model and training data, and consistently obtains considerable performance gains across multiple mathematical reasoning benchmarks. Our code, models, and datasets will be released.

多模态自进化数学推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。