构建大规模视觉语言推理数据集,显著提升模型推理能力。
HoneyBee: Data Recipes for Vision-Language Reasoners
- 系统研究数据来源、干预信号与数据规模对推理的影响
- 250万样本数据集使3B模型超越现有最优模型24.8%
- 提出测试时扩展策略,降低73%解码成本
近期视觉语言模型在推理任务中表现优异,但高效训练数据集的构建原则仍不明确。本文通过控制训练与评估设置,探索多种数据筛选方法及其对视觉语言推理能力的影响。研究发现:(a)上下文来源策略显著影响模型性能;(b)引入图像描述作为辅助信号或使用纯文本推理可带来显著提升;(c)扩大图像、问题和思维链(CoT)数量均能持续增强推理能力。基于这些发现,我们推出HoneyBee数据集,包含250万条样本,涵盖35万组图像-问题对。使用该数据集训练的3B参数模型在MathVerse上分别优于SOTA模型7.8%和基础模型24.8%。此外,我们提出一种测试时扩展策略,在不损失精度的前提下将解码成本降低73%。相关数据已开源。
原文摘要 · Abstract (English)
Recent advances in vision-language models (VLMs) have made them highly effective at reasoning tasks. However, the principles underlying the construction of performant VL reasoning training datasets remain poorly understood. In this work, we introduce several data curation approaches and study their impacts on VL reasoning capabilities by carefully controlling training and evaluation setups. We analyze the effects of context (image and question pair) sources, implement targeted data interventions, and explore scaling up images, questions, and chain-of-thought (CoT) solutions. Our findings reveal that (a) context source strategies significantly affect VLM performance, (b) interventions such as auxiliary signals from image captions and the inclusion of text-only reasoning yield substantial gains, and (c) scaling all data dimensions (e.g., unique questions per image and unique CoTs per image-question pair) consistently improves reasoning capability. Motivated by these insights, we introduce HoneyBee, a large-scale, high-quality CoT reasoning dataset with 2.5M examples consisting 350K image-question pairs. VLMs trained with HoneyBee outperform state-of-the-art models across model sizes. For instance, a HoneyBee-trained VLM with 3B parameters outperforms the SOTA model and the base model by 7.8% and 24.8%, respectively, on MathVerse. Furthermore, we propose a test-time scaling strategy that reduces decoding cost by 73% without sacrificing accuracy. Overall, this work presents improved strategies for VL reasoning dataset curation research. Data is available at https://huggingface.co/datasets/facebook/HoneyBee.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。