用统一流程与特征记忆库,提升遥感图像半监督分割精度
Bridging the Gap between Labeled and Unlabeled Data via Unified Flow with Feature Memory Bank

- 联合训练有标签与无标签数据,生成更少偏差的伪标签
- 在多个遥感数据集上达到当前最佳性能,显著提升伪标签质量
- 适合遥感图像分割、半监督学习研究者参考
尽管半监督语义分割(S⁴)利用大量无标签数据减轻人工标注负担,但有标签与无标签数据独立训练导致前者主导,严重降低伪标签质量。为此,我们提出一种基于统一流程与特征记忆库(UFFM)的新型遥感(RS)S⁴方法。该方法包含两项创新:统一流程(UF)通过外部视觉基础模型(VFM)与遥感领域教师模型结合,生成更少偏差的伪标签,并在统一目标下联合优化有标签与伪标签数据;特征记忆库(FMB)是一种新型记忆模块,动态更新类别特定特征,通过类特征对齐减少有标签与无标签数据间的特征差异。我们在多个遥感数据集上进行广泛实验,结果表明该方法优于现有SOTA S⁴方法,有效弥合了优化与特征表示上的差距。代码已开源。
原文摘要 · Abstract (English)
Although semi-supervised semantic segmentation ($\text{S}^4$) utilizes abundant unlabeled data to reduce manual labeling burdens, independent training of labeled and unlabeled data causes the former to dominate, which severely degrades pseudo-label quality. To address this challenges, we propose a novel remote sensing (RS) $\text{S}^4$ method via unified flow with feature memory bank (UFFM). Specifically, UFFM comprises two key innovations: unified flow (UF) and feature memory bank (FMB). The UF is a new training flow that generates less biased pseudo-labels by combining an external visual foundation model (VFM) with an RS domain teacher, and jointly optimizes labeled and pseudo-labeled data under a unified training objective. The FMB is a novel memory module for $\text{S}^4$ that dynamically updates class-specific features during training and reduces the feature discrepancy between labeled and unlabeled data through class-feature alignment. To verify the effectiveness of our model, we conduct extensive experiments on RS datasets. The experimental results show the superiority of our method over SOTA $\text{S}^4$ methods. Moreover, the results demonstrate the effectiveness of our contributions in bridging the optimization and feature representation gap between labeled and unlabeled data. Our code is released at \href{https://github.com/wangshanwen001/RS-UFFM}{https://github.com/wangshanwen001/RS-UFFM}.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。