用多智能体互动自动生成高质量图像文本对,提升几何推理能力。
Socratic-Geo: Synthetic Data Generation and Geometric Reasoning via Multi-Agent Interaction
- Teacher与Solver通过反馈循环动态生成带代码的图像文本对。
- 仅用1/4数据量,模型在6个基准上达到49.11分,优于基线2.43点。
- 适合需要高效训练数据生成的视觉语言模型研究者。
多模态大语言模型在视觉-语言理解上已取得显著进展,但几何推理能力仍受限于高质量图像-文本对极度稀缺。人工标注成本过高,自动方法难以保证真实性和训练有效性。现有方法或被动适应现有图像,或低效地随机探索后筛选,导致生成与学习脱节。我们提出Socratic-Geo,一种完全自主的框架,通过多智能体交互将数据合成与模型学习动态耦合。Teacher智能体生成带反思反馈(Reflect判断可解性,RePI验证视觉合理性)的参数化Python脚本,确保图像-文本对纯净性。Solver智能体通过偏好学习优化推理,失败路径引导Teacher进行针对性增强。独立地,Generator基于积累的“图像-代码-指令”三元组学习图像生成能力,将程序化绘图知识提炼为视觉生成能力。从仅108个种子问题出发,Socratic-Solver在六个基准上达到49.11分,仅需基线1/4数据量,超越强基线2.43分;Socratic-Generator在GenExam上达42.4%,刷新开源模型新纪录,超越Seedream-4.0(39.8%),接近Gemini-2.5-Flash-Image(43.1%)。
原文摘要 · Abstract (English)
Multimodal Large Language Models (MLLMs) have significantly advanced vision-language understanding. However, even state-of-the-art models struggle with geometric reasoning, revealing a critical bottleneck: the extreme scarcity of high-quality image-text pairs. Human annotation is prohibitively expensive, while automated methods fail to ensure fidelity and training effectiveness. Existing approaches either passively adapt to available images or employ inefficient random exploration with filtering, decoupling generation from learning needs. We propose Socratic-Geo, a fully autonomous framework that dynamically couples data synthesis with model learning through multi-agent interaction. The Teacher agent generates parameterized Python scripts with reflective feedback (Reflect for solvability, RePI for visual validity), ensuring image-text pair purity. The Solver agent optimizes reasoning through preference learning, with failure paths guiding Teacher's targeted augmentation. Independently, the Generator learns image generation capabilities on accumulated "image-code-instruction" triplets, distilling programmatic drawing intelligence into visual generation. Starting from only 108 seed problems, Socratic-Solver achieves 49.11 on six benchmarks using one-quarter of baseline data, surpassing strong baselines by 2.43 points. Socratic-Generator achieves 42.4% on GenExam, establishing new state-of-the-art for open-source models, surpassing Seedream-4.0 (39.8%) and approaching Gemini-2.5-Flash-Image (43.1%).
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。