用轻量微调让地理空间大模型更高效,性能不降反升。
Fine-tune Smarter, Not Harder: Parameter-Efficient Fine-Tuning for Geospatial Foundation Models
- 采用参数高效微调技术,仅更新少量参数提升模型适应性。
- 在5个遥感数据集上,性能媲美甚至超过全量微调,且训练更快、内存更低。
- 推荐使用UNet解码器并避免元数据,适合快速部署地理分析任务。
地球观测对监测环境变化、灾害响应和资源管理至关重要。在此背景下,基础模型可高效准确地分析遥感图像以提取地理信息。然而,随着模型规模增大,全量微调面临计算资源与成本高、易遗忘预训练特征、泛化能力下降等问题。为此,参数高效微调(PEFT)提供了一种可行方案。本文在五种不同地球观测数据集上,系统评估了多种基础模型架构与PEFT方法的效能。结果表明,PEFT不仅达到或超越全量微调性能,还增强了模型在未见地理区域的泛化能力,同时显著降低训练时间和内存消耗。额外实验发现,选用UNet解码器并禁用元数据微调为最优配置。我们已将所有评估模型与方法集成至开源工具包TerraTorch,支持快速、可扩展、低成本的模型适配。
原文摘要 · Abstract (English)
Earth observation (EO) is crucial for monitoring environmental changes, responding to disasters, and managing natural resources. In this context, foundation models facilitate remote sensing image analysis to retrieve relevant geoinformation accurately and efficiently. However, as these models grow in size, fine-tuning becomes increasingly challenging due to the associated computational resources and costs, limiting their accessibility and scalability. Furthermore, full fine-tuning can lead to forgetting pre-trained features and even degrade model generalization. To address this, Parameter-Efficient Fine-Tuning (PEFT) techniques offer a promising solution. In this paper, we conduct extensive experiments with various foundation model architectures and PEFT techniques to evaluate their effectiveness on five different EO datasets. Our results provide a comprehensive comparison, offering insights into when and how PEFT methods support the adaptation of pre-trained geospatial models. We demonstrate that PEFT techniques match or even exceed full fine-tuning performance and enhance model generalisation to unseen geographic regions, while reducing training time and memory requirements. Additional experiments investigate the effect of architecture choices such as the decoder type or the use of metadata, suggesting UNet decoders and fine-tuning without metadata as the recommended configuration. We have integrated all evaluated foundation models and techniques into the open-source package TerraTorch to support quick, scalable, and cost-effective model adaptation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。