用已有模型权重生成新模型,统一遥感知识表示。
GeoSANE: Learning Geospatial Representations from Models, Not Data
- 从多个模型权重中学习统一表示,按需生成新网络权重
- 生成模型在10个数据集上表现优于从零训练的模型
- 适合需要快速构建轻量级遥感模型的研究者
近期遥感领域涌现出大量基础模型,各自基于不同模态、数据集和目标训练,仅覆盖部分地理空间知识。尽管各模型在特定任务表现优异,但能力互补而非统一。为此,我们提出GeoSANE——一个从现有基础模型与任务专用模型的权重中学习统一神经表示的模型工厂,可按需生成新的神经网络权重。给定目标架构后,GeoSANE能生成直接用于微调的分类、分割、检测等任务权重,覆盖多种模态。在十个多样化数据集及GEO-Bench上的评估表明,其生成模型性能稳定优于从零训练的基线,达到或超越当前主流遥感基础模型水平;在生成轻量级网络时,效果也优于剪枝或知识蒸馏方法。通过将预训练转向权重生成,GeoSANE为跨模型、跨任务的知识统一与迁移提供了新范式。代码已公开于 hsg-aiml.github.io/GeoSANE/
原文摘要 · Abstract (English)
Recent advances in remote sensing have led to an increase in the number of available foundation models; each trained on different modalities, datasets, and objectives, yet capturing only part of the vast geospatial knowledge landscape. While these models show strong results within their respective domains, their capabilities remain complementary rather than unified. Therefore, instead of choosing one model over another, we aim to combine their strengths into a single shared representation. We introduce GeoSANE, a geospatial model foundry that learns a unified neural representation from the weights of existing foundation models and task-specific models, able to generate novel neural networks weights on-demand. Given a target architecture, GeoSANE generates weights ready for finetuning for classification, segmentation, and detection tasks across multiple modalities. Models generated by GeoSANE consistently outperform their counterparts trained from scratch, match or surpass state-of-the-art remote sensing foundation models, and outperform models obtained through pruning or knowledge distillation when generating lightweight networks. Evaluations across ten diverse datasets and on GEO-Bench confirm its strong generalization capabilities. By shifting from pre-training to weight generation, GeoSANE introduces a new framework for unifying and transferring geospatial knowledge across models and tasks. Code is available at \href{https://hsg-aiml.github.io/GeoSANE/}{hsg-aiml.github.io/GeoSANE/}.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。