arXiv:2511.02607cs.CVcs.CL2025-11被引 8

首个融合多模态大模型的统一变化检测框架,支持多种数据源协同学习。

UniChange: Unifying Change Detection with Multimodal Large Language Model

  • 用特殊标记整合二分类与语义变化检测任务
  • 在4个公开数据集上达到最高90.41的交并比
  • 无需预设分类头,适配不同类定义的数据集

变化检测(CD)是监测和分析地表覆盖动态的基础任务。尽管近期高性能模型和高质量数据集显著推动了该领域发展,但一个关键局限依然存在:现有模型通常仅从单一类型标注数据中获取有限知识,无法同时利用二分类变化检测(BCD)和语义变化检测(SCD)数据集。这一限制导致泛化能力差、适用性有限。多模态大语言模型(MLLMs)的进展为统一的CD框架提供了新可能。我们利用MLLM的语言先验与融合能力,提出UniChange——首个基于MLLM的统一变化检测模型。该模型结合生成语言能力与专用变化检测功能,通过引入三个特殊标记[ T1]、[T2]和[CHANGE],成功统一了BCD与SCD任务。同时,采用文本提示引导变化类别识别,摆脱对预定义分类头的依赖。这一设计使UniChange能有效从多源数据中学习,即使其类别定义不一致也具备适应能力。在四个公开基准(WHU-CD、S2Looking、LEVIR-CD+、SECOND)上的实验表明,其表现达到最先进水平,分别取得90.41、53.04、78.87、57.62的交并比,超越所有已有方法。代码已开源。

原文摘要 · Abstract (English)

Change detection (CD) is a fundamental task for monitoring and analyzing land cover dynamics. While recent high performance models and high quality datasets have significantly advanced the field, a critical limitation persists. Current models typically acquire limited knowledge from single-type annotated data and cannot concurrently leverage diverse binary change detection (BCD) and semantic change detection (SCD) datasets. This constraint leads to poor generalization and limited versatility. The recent advancements in Multimodal Large Language Models (MLLMs) introduce new possibilities for a unified CD framework. We leverage the language priors and unification capabilities of MLLMs to develop UniChange, the first MLLM-based unified change detection model. UniChange integrates generative language abilities with specialized CD functionalities. Our model successfully unifies both BCD and SCD tasks through the introduction of three special tokens: [T1], [T2], and [CHANGE]. Furthermore, UniChange utilizes text prompts to guide the identification of change categories, eliminating the reliance on predefined classification heads. This design allows UniChange to effectively acquire knowledge from multi-source datasets, even when their class definitions conflict. Experiments on four public benchmarks (WHU-CD, S2Looking, LEVIR-CD+, and SECOND) demonstrate SOTA performance, achieving IoU scores of 90.41, 53.04, 78.87, and 57.62, respectively, surpassing all previous methods. The code is available at https://github.com/Erxucomeon/UniChange.

变化检测多模态大模型统一框架遥感

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。