提出ReasonCD模型,让遥感图像能理解用户隐含的变更意图。
ReasonCD: A Multimodal Reasoning Large Model for Implicit Change-of-Interest Semantic Mining
- 用大语言模型挖掘用户未明说的变更需求
- 在BCDD数据集上达92.1%的F1分数
- 能解释推理过程,适合需要可解释性的场景
遥感图像变化检测是遥感智能解译中的基础任务,核心目标是识别感兴趣变化区域(CRoI)内的变化。当前多模态大模型虽蕴含丰富的人类语义知识,可用于引导遥感变化检测任务,但现有方法依赖对CRoI的显式文本描述,当面对隐含描述时性能几乎完全失效。本文提出一种名为ReasonCD的多模态推理变化检测模型,具备挖掘用户隐含任务意图的能力。该模型利用预训练大语言模型的强大推理能力,挖掘用户隐含的任务意图,并据此生成不同的变化检测结果。在公开数据集上的实验表明,该模型在BCDD数据集上取得了92.1%的F1分数。为进一步验证其优越的推理能力,本文基于SECOND数据集标注了推理数据子集。实验结果表明,该模型不仅在基于推理的变化检测任务中表现优异,还能解释推理过程,辅助人类决策。
原文摘要 · Abstract (English)
Remote sensing image change detection is one of the fundamental tasks in remote sensing intelligent interpretation. Its core objective is to identify changes within change regions of interest (CRoI). Current multimodal large models encode rich human semantic knowledge, which is utilized for guidance in tasks such as remote sensing change detection. However, existing methods that use semantic guidance for detecting users' CRoI overly rely on explicit textual descriptions of CRoI, leading to the problem of near-complete performance failure when presented with implicit CRoI textual descriptions. This paper proposes a multimodal reasoning change detection model named ReasonCD, capable of mining users' implicit task intent. The model leverages the powerful reasoning capabilities of pre-trained large language models to mine users' implicit task intents and subsequently obtains different change detection results based on these intents. Experiments on public datasets demonstrate that the model achieves excellent change detection performance, with an F1 score of 92.1\% on the BCDD dataset. Furthermore, to validate its superior reasoning functionality, this paper annotates a subset of reasoning data based on the SECOND dataset. Experimental results show that the model not only excels at basic reasoning-based change detection tasks but can also explain the reasoning process to aid human decision-making.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。