提出新模型与数据集,让AI能精准数清卫星图中的物体数量。
Reasoning with Pixel-level Precision: QVLM Architecture and SQuID Dataset for Quantitative Geospatial Analytics
- 用代码生成方式保持像素精度,不压缩图像信息
- 在新数据集上准确率提升至42.0%,远超传统模型的28.1%
- 适合需要精确测量与计数的遥感分析任务
现有视觉语言模型因图像编码时采用块嵌入,丢失像素级信息,难以完成量化空间推理。为此,我们提出SQuID(卫星量化智能数据集),包含2000对卫星图像问答对,涵盖数值与类别答案,分三个难度层级,标注基于人工标签及其学习到的变异性生成。同时提出QVLM(量化视觉语言模型),通过解耦语言理解与视觉分析,不将图像编码为嵌入,而是生成可执行代码:先调用分割模型获取像素级掩码,再直接操作这些掩码,全程保留空间索引。实验表明,使用GPT-5作为代码生成器的QVLM在SQuID上达到42.0%准确率,显著优于仅以图像-问题提示的传统模型的28.1%。结果表明,架构解耦有助于提升量化空间任务的准确性。
原文摘要 · Abstract (English)
Current Vision-Language Models (VLMs) fail at quantitative spatial reasoning because their architectures destroy pixel-level information required for counting and measurements. Vision encoders compress images through patch embeddings, reducing spatial indexing and losing the precise pixel-level tracking required for accurate counting. We present two contributions to address this fundamental limitation. First, we introduce SQuID (Satellite Quantitative Intelligence Dataset), a benchmark of 2,000 satellite image Question-Answer pairs with both numerical range and categorical answers, designed to evaluate quantitative spatial reasoning. The dataset spans three difficulty tiers with annotations automatically generated from human labels and their learned variability. Second, we propose QVLM (Quantitative Vision-Language Model), a code-generation architecture that maintains pixel precision by decoupling language understanding from visual analysis. Instead of encoding images into embeddings, QVLM generates executable code that first calls a segmentation model to obtain pixel-level masks, then operates directly on these masks, preserving spatial indexing throughout the reasoning process. Our experiments show that QVLM using GPT-5 as coder achieves 42.0% accuracy on SQuID compared to 28.1% for a VLM prompted with image-question pairs. Our work reveals that, for quantitative spatial reasoning, architectural decoupling enables better accuracy on quantitative tasks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。