arXiv:2603.09625cs.CVcs.AI2026-03中稿 · presentation at IE…被引 3

用视觉语言模型生成并评估遥感合成数据,提升分割与描述任务性能。

Grounding Synthetic Data Generation With Vision and Language Models

  • 融合生成模型、分割与图像描述,实现可解释的合成数据生成
  • 300万合成图像+100万真实图像,混合训练模型超越纯真实数据基线
  • 适合遥感领域研究者,尤其关注数据增强与跨模态一致性的场景

深度学习模型受益于数据多样性和数量增长,推动了合成数据增强以改进现有数据集。然而,现有合成数据评估指标多基于潜在特征相似性,难以解释且与下游任务贡献不总相关。本文提出一种基于视觉-语言模型的可解释合成数据生成与评估框架,用于遥感领域。该方法结合生成模型、语义分割和图像描述技术,构建了大规模遥感数据集ARAS400k,包含10万张真实图像与300万张合成图像,每张均配有分割图和文字描述。该数据集支持自动化评估,通过分析语义构成、减少描述冗余、验证视觉与语言的一致性。实验表明,仅使用合成数据训练的模型达到可比性能,而混合真实与合成数据训练的模型始终优于仅用真实数据的基线。本工作建立了遥感语义分割与图像描述任务的可扩展基准。数据集可在zenodo.org/records/18890661获取,代码见github.com/caglarmert/ARAS400k。

原文摘要 · Abstract (English)

Deep learning models benefit from increasing data diversity and volume, motivating synthetic data augmentation to improve existing datasets. However, existing evaluation metrics for synthetic data typically calculate latent feature similarity, which is difficult to interpret and does not always correlate with the contribution to downstream tasks. We propose a vision-language grounded framework for interpretable synthetic data augmentation and evaluation in remote sensing. Our approach combines generative models, semantic segmentation and image captioning with vision and language models. Based on this framework, we introduce ARAS400k: A large-scale Remote sensing dataset Augmented with Synthetic data for segmentation and captioning, containing 100k real images and 300k synthetic images, each paired with segmentation maps and descriptions. ARAS400k enables the automated evaluation of synthetic data by analyzing semantic composition, minimizing caption redundancy, and verifying cross-modal consistency between visual structures and language descriptions. Experimental results indicate that while models trained exclusively on synthetic data reach competitive performance levels, those trained with augmented data (a combination of real and synthetic images) consistently outperform real-data baselines. Consequently, this work establishes a scalable benchmark for remote sensing tasks, specifically in semantic segmentation and image captioning. The dataset is available at zenodo.org/records/18890661 and the code base at github.com/caglarmert/ARAS400k.

遥感数据合成数据视觉语言模型图像描述

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。