arXiv:2606.11719cs.CVcs.AI2026-06

让模型自动生成适配自身能力的几何推理题,提升学习效率。

Ouroboros-Spatial: Closing the Data-Model Loop for Spatial Reasoning

论文配图:Ouroboros-Spatial: Closing the Data-Model Loop for Spatial Reasoning
图 1 · 摘自论文原文
  • 模型轮流当出题人和解题人,动态生成匹配当前水平的题目。
  • 用更少数据(少一个数量级)达到更好效果,最大提分9.9点。
  • 适合研究视觉语言模型、高效训练方法的人参考。

空间推理仍是多模态大模型的持续挑战。现有方法依赖大规模静态数据集,所有样本统一处理,忽视模型能力演进。为此,我们提出Ouroboros-Spatial,一种自我演化的训练框架:冻结的出题模块从3D场景元数据和原始视频帧中生成带可执行代码的问答对,以确保可靠真值;可学习的求解模块在被接受的样本上微调,并利用每样本预测置信度作为难度信号反馈给出题模块。通过这一闭环设计,训练分布随模型能力同步演化,减少冗余简单样本,过滤低价值模糊样本。在六个空间推理基准上,Ouroboros-Spatial显著提升Qwen3-VL-4B和Qwen3-VL-8B性能,训练样本量仅为近期大规模数据集的十分之一。在VSI-Bench上,4B和8B模型分别获得9.9和6.8的绝对提升,均超越众多开源与闭源基线。

原文摘要 · Abstract (English)

Spatial reasoning remains a persistent challenge for multimodal large language models (MLLMs). Existing approaches largely rely on large-scale, statically curated datasets, where all training samples are treated uniformly regardless of the model's evolving capabilities. This static paradigm is inherently data-inefficient: training capacity is often spent on samples that are either trivial or overly difficult for the model at its current stage. To address this limitation, we propose Ouroboros-Spatial, a self-evolving training framework in which the model plays dual roles as a proposer and a solver. In each iteration, a frozen proposer generates spatial question-answer (QA) pairs from 3D scene metadata and raw video frames, together with executable code for deriving reliable ground truth. A learnable solver is then fine-tuned on the accepted samples, and its per-sample prediction confidence is used as a difficulty signal. This signal is fed back to the proposer in the next iteration, guiding it to generate questions better matched to the solver's current capabilities. Through this closed-loop design, the training distribution co-evolves with model ability, reducing redundant trivial examples while filtering out ambiguous or uninformative samples with limited learning value. Across six spatial reasoning benchmarks, Ouroboros-Spatial substantially improves Qwen3-VL-4B and Qwen3-VL-8B while using an order of magnitude fewer training examples than recent large-scale curated datasets. On VSI-Bench, it yields absolute gains of 9.9 and 6.8 points for the 4B and 8B models, respectively, enabling both to outperform a wide range of strong open-source and proprietary baselines.

空间推理自进化高效训练多模态

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。