arXiv:2511.21523cs.CV2025-11

用多个轻量专家模型组合,高效构建遥感基础模型。

EoS-FM: Can an Ensemble of Specialist Models act as a Generalist Feature Extractor?

  • 将任务拆分为轻量ConvNeXtV2专家模型,可冻结复用。
  • 相比大模型更省资源,支持联邦训练与持续集成。
  • 适合资源受限团队协作,推动可持续遥感AI。

近期基础模型在自然语言处理和计算机视觉领域取得显著进展,遥感领域也正涌现出类似尝试。这些模型旨在以少量标注数据实现跨任务泛化,减少为每个任务单独训练模型的需求。然而,当前主流方法依赖扩大模型规模和数据集体积,需巨大算力与数据资源,仅少数大型机构可负担。该范式还违背可持续AI原则,造成高碳排放与资源浪费。本文提出一种新型高效方案:基于专家集成的遥感基础模型(RSFM)框架。该方法将训练过程分解为多个轻量、任务专用的ConvNeXtV2专家模型,可冻结并重复使用。这种模块化设计在效率、可解释性与可扩展性方面优势显著,并天然支持联邦学习、剪枝与持续专家添加,特别适用于协作与资源受限场景。本工作为构建可扩展、高效的遥感基础模型开辟新方向。所有代码与预训练模型已开源至 https://github.com/pierreadorni/EoS-FM。

原文摘要 · Abstract (English)

Recent advances in foundation models have shown great promise in domains such as natural language processing and computer vision, and similar efforts are now emerging in the Earth Observation community. These models aim to generalize across tasks with limited supervision, reducing the need for training separate models for each task. However, current strategies, which largely focus on scaling model size and dataset volume, require prohibitive computational and data resources, limiting accessibility to only a few large institutions. Moreover, this paradigm of ever-larger models stands in stark contrast with the principles of sustainable and environmentally responsible AI, as it leads to immense carbon footprints and resource inefficiency. In this work, we present a novel and efficient alternative: an Ensemble-of-Specialists framework for building Remote Sensing Foundation Models (RSFMs). Our method decomposes the training process into lightweight, task-specific ConvNeXtV2 specialists that can be frozen and reused. This modular approach offers strong advantages in efficiency, interpretability, and extensibility. Moreover, it naturally supports federated training, pruning, and continuous specialist integration, making it particularly well-suited for collaborative and resource-constrained settings. Our framework sets a new direction for building scalable and efficient RSFMs. All codes and pretrained models are available on the public repo at https://github.com/pierreadorni/EoS-FM .

遥感基础模型专家集成可持续AI

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。