arXiv:2601.04497cs.CVcs.AI2026-01中稿 · to IGARSS 2026

用大模型驱动的视觉语言代理,实现森林变化的自然语言交互分析。

Vision-Language Agents for Interactive Forest Change Analysis

  • 基于多层级变化理解框架与大模型协同,支持自然语言查询
  • 在森林变化数据集上达成67.10% mIoU与40.17% BLEU-4
  • 适合遥感、林业监测人员快速理解复杂林地动态变化

现代森林监测工作日益受益于高分辨率卫星影像和深度学习的发展。当前仍面临两大挑战:像素级变化检测的准确性,以及对复杂森林动态进行有意义的语义变化描述。尽管大语言模型(LLMs)正被用于交互式数据探索,但其与视觉-语言模型(VLMs)在遥感图像变化解释(RSICI)中的融合仍研究不足。为此,我们提出一种由LLM驱动的智能体系统,支持对多个RSICI任务进行自然语言查询。该系统基于多层级变化解释(MCI)视觉-语言主干,并采用LLM进行任务编排。为促进在森林场景中的适配与评估,我们构建了Forest-Change数据集,包含双时相卫星影像、像素级变化掩码,以及通过人工标注与规则方法生成的多粒度语义变化描述。实验表明,该系统在Forest-Change数据集上达到67.10% mIoU与40.17% BLEU-4,在LEVIR-MCI-Trees(LEVIR-MCI中专注于树木的子集)上达到88.13% mIoU与34.41% BLEU-4。结果证明,交互式LLM驱动的RSICI系统能显著提升森林变化分析的可访问性、可解释性与效率。所有数据与代码公开于https://github.com/JamesBrockUoB/ForestChat。

原文摘要 · Abstract (English)

Modern forest monitoring workflows increasingly benefit from the growing availability of high-resolution satellite imagery and advances in deep learning. Two persistent challenges in this context are accurate pixel-level change detection and meaningful semantic change captioning for complex forest dynamics. While large language models (LLMs) are being adapted for interactive data exploration, their integration with vision-language models (VLMs) for remote sensing image change interpretation (RSICI) remains underexplored. To address this gap, we introduce an LLM-driven agent for integrated forest change analysis that supports natural language querying across multiple RSICI tasks. The proposed system builds upon a multi-level change interpretation (MCI) vision-language backbone with LLM-based orchestration. To facilitate adaptation and evaluation in forest environments, we further introduce the Forest-Change dataset, which comprises bi-temporal satellite imagery, pixel-level change masks, and multi-granularity semantic change captions generated using a combination of human annotation and rule-based methods. Experimental results show that the proposed system achieves mIoU and BLEU-4 scores of 67.10% and 40.17% on the Forest-Change dataset, and 88.13% and 34.41% on LEVIR-MCI-Trees, a tree-focused subset of LEVIR-MCI benchmark for joint change detection and captioning. These results highlight the potential of interactive, LLM-driven RSICI systems to improve accessibility, interpretability, and efficiency of forest change analysis. All data and code are publicly available at https://github.com/JamesBrockUoB/ForestChat.

视觉语言森林监测大模型应用遥感分析

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。