针对遥感图像类别内差异大的问题,提出带中心引导的分类器提升分割精度与可解释性。
Center-guided Classifier for Semantic Segmentation of Remote Sensing Images
- 为每类生成多个原型,通过注意力与动量更新优化特征聚类。
- 在三个遥感数据集上实现更优分割性能,优于标准Softmax分类器。
- 模型轻量简洁,推理时可回溯训练样本,增强决策可解释性。
与自然图像相比,遥感图像具有更大的类别内差异,使语义分割更具挑战性。现有遥感图像分割模型通常采用基础Softmax分类器,存在三方面缺陷:(1) 训练中对像素表示缺乏直接监督;(2) 在类别内差异大时参数化Softmax分类器建模能力不足;(3) 分类过程不透明。本文提出一种专用于遥感图像语义分割的新分类器CenterSeg,通过多原型、基于流形空间的直接监督和可解释策略解决上述问题。具体地,针对每类,利用真值掩码聚合像素特征获取局部类别中心,并通过硬注意力分配与动量更新生成多个原型。同时引入格拉斯曼流形,通过两项正则项约束像素特征与原型的联合嵌入空间。尤其在推理阶段,可通过将原型视为训练集样本来提供模型可解释性。在三个遥感图像分割数据集上的实验验证了该方法的有效性。除性能优越外,CenterSeg还具备简单、轻量、兼容性强和可解释等优势。代码已开源:https://github.com/xwmaxwma/rssegmentation。
原文摘要 · Abstract (English)
Compared with natural images, remote sensing images (RSIs) have the unique characteristic. i.e., larger intraclass variance, which makes semantic segmentation for remote sensing images more challenging. Moreover, existing semantic segmentation models for remote sensing images usually employ a vanilla softmax classifier, which has three drawbacks: (1) non-direct supervision for the pixel representations during training; (2) inadequate modeling ability of parametric softmax classifiers under large intraclass variance; and (3) opaque process of classification decision. In this paper, we propose a novel classifier (called CenterSeg) customized for RSI semantic segmentation, which solves the abovementioned problems with multiple prototypes, direct supervision under Grassmann manifold, and interpretability strategy. Specifically, for each class, our CenterSeg obtains local class centers by aggregating corresponding pixel features based on ground-truth masks, and generates multiple prototypes through hard attention assignment and momentum updating. In addition, we introduce the Grassmann manifold and constrain the joint embedding space of pixel features and prototypes based on two additional regularization terms. Especially, during the inference, CenterSeg can further provide interpretability to the model by restricting the prototype as a sample of the training set. Experimental results on three remote sensing segmentation datasets validate the effectiveness of the model. Besides the superior performance, CenterSeg has the advantages of simplicity, lightweight, compatibility, and interpretability. Code is available at https://github.com/xwmaxwma/rssegmentation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。