预训练的遥感表示不确定性在跨域任务中表现稳健,提升遥感可信度。
On the Generalization of Representation Uncertainty in Earth Observation
- 在遥感数据上预训练表示不确定性,实现零样本泛化。
- 在多标签分类与分割任务中保持对地物尺度变化的敏感性。
- 适合遥感图像分析、可信AI研究者参考。
计算机视觉中预训练表示不确定性技术可实现零样本不确定性估计,对遥感(EO)领域具有重要意义,但其复杂数据特性带来挑战。本文研究了遥感表示不确定性的泛化能力,基于大规模遥感数据预训练不确定性,并构建评估框架,在多标签分类与分割任务中测试其零样本性能。结果表明,相较于自然图像预训练的不确定性,遥感预训练在未见遥感域、地理区域及目标粒度间表现出强泛化能力,同时对地面采样距离变化保持敏感。实验证明预训练不确定性能有效对齐下游任务中的特定不确定性,响应真实遥感图像噪声,并可直接生成空间不确定性图。本研究开启遥感表示不确定性讨论,揭示其优势与局限,为后续研究提供方向。代码与权重已开源:https://github.com/Orion-AI-Lab/EOUncertaintyGeneralization。
原文摘要 · Abstract (English)
Recent advances in Computer Vision have introduced the concept of pretrained representation uncertainty, enabling zero-shot uncertainty estimation. This holds significant potential for Earth Observation (EO), where trustworthiness is critical, yet the complexity of EO data poses challenges to uncertainty-aware methods. In this work, we investigate the generalization of representation uncertainty in EO, considering the domain's unique semantic characteristics. We pretrain uncertainties on large EO datasets and propose an evaluation framework to assess their zero-shot performance in multi-label classification and segmentation EO tasks. Our findings reveal that, unlike uncertainties pretrained on natural images, EO-pretraining exhibits strong generalization across unseen EO domains, geographic locations, and target granularities, while maintaining sensitivity to variations in ground sampling distance. We demonstrate the practical utility of pretrained uncertainties showcasing their alignment with task-specific uncertainties in downstream tasks, their sensitivity to real-world EO image noise, and their ability to generate spatial uncertainty estimates out-of-the-box. Initiating the discussion on representation uncertainty in EO, our study provides insights into its strengths and limitations, paving the way for future research in the field. Code and weights are available at: https://github.com/Orion-AI-Lab/EOUncertaintyGeneralization.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。