arXiv:2606.06363cs.CV2026-06

用NDVI引导的全局记忆库提升城市绿地提取精度

GMBFormer: An NDVI-Guided Global Memory Bank Transformer for Urban Green-Space Extraction from Ultra-High-Resolution Imagery

论文配图:GMBFormer: An NDVI-Guided Global Memory Bank Transformer for Urban Green-Space Extraction from Ultra-High-Resolution Imagery
图 1 · 摘自论文原文
  • 将NDVI作为物理先验,分离视觉与植被可信度学习
  • 通过记忆检索实现跨区域相似植被模式复用,mIoU达89.25%
  • 适合高分辨率遥感图像中绿地提取任务,尤其标注数据少时

从超高清(UHR)影像中提取城市绿地通常按块处理,限制了空间分离但视觉相似的植被模式之间的语义复用。直接将归一化植被指数(NDVI)注入RGB骨干网络会模糊视觉外观学习与物理植被置信度的分工。本文提出GMBFormer,一种基于SegFormer的框架,以选择性、相似性驱动的原型检索替代依赖邻接关系的特征传播。仅RGB通道进入骨干和解码器,而NDVI被解耦为物理感知门控,通过动量更新将高置信度植被描述符存入紧凑的全局记忆库。训练和推理时,当前图像块通过记忆介导的交叉注意力查询存储的原型,检索结果以有限开销整合。实验使用自建成都超高清数据集(7,700张512×512标签图像),以及从公开的ISPRS Potsdam数据集衍生的两种少标签设置。在相同训练与评估协议下,GMBFormer在三种设置中的平均交并比(mIoU)/平均骰率(mDice)分别为89.25%/94.31%、92.17%/95.92%和83.72%/90.86%,均优于对照的SegFormer-B4基线。消融实验表明,解耦的NDVI准入、记忆检索、容量及动量机制共同决定最终性能。

原文摘要 · Abstract (English)

Urban green-space extraction from ultra-high-resolution (UHR) imagery is commonly performed patch by patch, which limits semantic reuse among spatially separated but visually similar vegetation patterns. Directly injecting the Normalized Difference Vegetation Index (NDVI) into red-green-blue (RGB) backbones can also blur the roles of visual appearance learning and physical vegetation confidence. We propose GMBFormer, a SegFormer-based framework that replaces adjacency-driven feature propagation with selective, similarity-driven prototype retrieval. Only RGB channels enter the backbone and decoder, while NDVI is decoupled as a physics-informed gate that admits high-confidence vegetation descriptors into a compact global memory bank through momentum updates. During training and inference, the current patch queries stored prototypes through memory-mediated cross-attention, and the retrieved response is integrated with bounded overhead. Experiments use a self-constructed Chengdu UHR dataset with 7,700 labeled 512 x 512 patches and two reduced-label settings derived from the public International Society for Photogrammetry and Remote Sensing (ISPRS) Potsdam dataset. Under the same training and evaluation protocol, GMBFormer obtains mean intersection over union (mIoU)/mean Dice (mDice) scores of 89.25%/94.31%, 92.17%/95.92%, and 83.72%/90.86%, respectively, improving the controlled SegFormer-B4 baseline in each setting. Ablation studies indicate that decoupled NDVI admission, memory retrieval, capacity, and momentum jointly shape the final performance.

绿地提取遥感影像注意力机制深度学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。