提出新方法提升遥感图像自监督学习在雾霾等退化下的鲁棒性
Trust-SSL: Additive-Residual Selective Invariance for Robust Aerial Self-Supervised Learning

- 引入可加残差的信任权重,动态调节不同退化因素的对齐强度
- 在三个数据集上线性探测准确率达90.20%,严重雾霾下比SimCLR高19.9点
- 新增可信度感知机制,适合处理真实世界中复杂退化的遥感图像
自监督学习(SSL)是航空影像表示学习的标准方法。现有方法通过增强视图间不变性来训练,但在雾霾、运动模糊、雨滴和遮挡等退化情况下,关键信息被移除,强制对齐干净与严重退化视图会引入虚假结构。本文提出一种训练策略与架构改进,增强SSL对这类退化的鲁棒性。引入每样本、每因子的信任权重,以可加残差形式融合基础对比损失,并对信任权重施加停止梯度。相比乘法门控,该设计避免损害主干网络,反而提升性能。在包含21万张图像的数据集上使用200轮训练,该方法在EuroSAT、AID和NWPU-RESISC45上六种主干网络的平均线性探测准确率最高,达90.20%(高于SimCLR的88.46%和VICReg的89.82%)。在EuroSAT上严重雾霾(s=5)条件下,较SimCLR提升19.9分。零样本跨域压力测试中,于BDD100K天气划分上,马哈拉诺比斯AUROC提升1至3分。两种消融实验(标量不确定性与余弦门控)表明,可加残差结构是主要贡献来源。基于Dempster-Shafer融合的证据变体还提供冲突与无知的可解释信号。这些发现为不确定性感知的自监督学习提供了具体设计原则。代码已公开:https://github.com/WadiiBoulila/trust-ssl。
原文摘要 · Abstract (English)
Self-supervised learning (SSL) is a standard approach for representation learning in aerial imagery. Existing methods enforce invariance between augmented views, which works well when augmentations preserve semantic content. However, aerial images are frequently degraded by haze, motion blur, rain, and occlusion that remove critical evidence. Enforcing alignment between a clean and a severely degraded view can introduce spurious structure into the latent space. This study proposes a training strategy and architectural modification to enhance SSL robustness to such corruptions. It introduces a per-sample, per-factor trust weight into the alignment objective, combined with the base contrastive loss as an additive residual. A stop-gradient is applied to the trust weight instead of a multiplicative gate. While a multiplicative gate is a natural choice, experiments show it impairs the backbone, whereas our additive-residual approach improves it. Using a 200-epoch protocol on a 210,000-image corpus, the method achieves the highest mean linear-probe accuracy among six backbones on EuroSAT, AID, and NWPU-RESISC45 (90.20% compared to 88.46% for SimCLR and 89.82% for VICReg). It yields the largest improvements under severe information-erasing corruptions on EuroSAT (+19.9 points on haze at s=5 over SimCLR). The method also demonstrates consistent gains of +1 to +3 points in Mahalanobis AUROC on a zero-shot cross-domain stress test using BDD100K weather splits. Two ablations (scalar uncertainty and cosine gate) indicate the additive-residual formulation is the primary source of these improvements. An evidential variant using Dempster-Shafer fusion introduces interpretable signals of conflict and ignorance. These findings offer a concrete design principle for uncertainty-aware SSL. Code is publicly available at https://github.com/WadiiBoulila/trust-ssl.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。