构建首个面向遥感变化细粒度推理的问答基准数据集
RSRCC: A Remote Sensing Regional Change Comprehension Benchmark Constructed via Retrieval-Augmented Best-of-N Ranking

- 用检索增强的Best-of-N排序构建细粒度变化问答数据
- 包含12.6万条问题,涵盖训练、验证与测试集
- 适合需要解释变化语义的遥感分析研究者使用
传统变化检测仅定位变化位置,无法用自然语言解释变化内容。现有遥感变化描述数据集多聚焦整体图像差异,缺乏对局部语义变化的细粒度推理。为此,我们提出RSRCC,一个面向遥感变化问答的新基准,包含12.6万条问题(训练8.7万、验证1.71万、测试2.2万),围绕特定区域的变更问题设计,要求对具体语义变化进行推理。这是首个专为细粒度推理监督构建的遥感变化问答基准。数据构建采用分层半监督筛选流程:先从语义分割掩码中提取候选变化区域,再通过图文嵌入模型初筛,最后通过检索增强的视觉-语言校验与Best-of-N排序完成最终消歧。该方法可规模化过滤噪声和模糊样本,同时保留有意义的变化语义。数据集已公开于https://huggingface.co/datasets/google/RSRCC。
原文摘要 · Abstract (English)
Traditional change detection identifies where changes occur, but does not explain what changed in natural language. Existing remote sensing change captioning datasets typically describe overall image-level differences, leaving fine-grained localized semantic reasoning largely unexplored. To close this gap, we present RSRCC, a new benchmark for remote sensing change question-answering containing 126k questions, split into 87k training, 17.1k validation, and 22k test instances. Unlike prior datasets, RSRCC is built around localized, change-specific questions that require reasoning about a particular semantic change. To the best of our knowledge, this is the first remote sensing change question-answering benchmark designed explicitly for such fine-grained reasoning-based supervision. To construct RSRCC, we introduce a hierarchical semi-supervised curation pipeline that uses Best-of-N ranking as a critical final ambiguity-resolution stage. First, candidate change regions are extracted from semantic segmentation masks, then initially screened using an image-text embedding model, and finally validated through retrieval-augmented vision-language curation with Best-of-N ranking. This process enables scalable filtering of noisy and ambiguous candidates while preserving semantically meaningful changes. The dataset is available at https://huggingface.co/datasets/google/RSRCC.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。