90亿参数的地球观测生成模型,原生支持地理信息,可实现高精度云去噪与跨模态图像转换。
GeoCore-9B: Towards Geo-Aware Generative Foundation Models in Earth Observation

- 从零训练90亿参数模型,直接用遥感数据构建,避免自然图像偏差。
- 在云去除和雷达转光学图像任务上达到新SOTA,地理结构准确性显著提升。
- 适合遥感、环境监测、城市规划等需要精准地理信息的应用场景。
现有的地球观测(EO)生成模型主要依赖于自然图像先验的微调,限制了其可扩展性并引入视角偏差,与地理空间约束冲突。为此,我们提出GeoCore-9B,一个90亿参数的生成基础模型,是首个完全从头训练且仅使用EO数据的同规模模型。不同于以往模型,GeoCore-9B基于基于流匹配的扩散Transformer(DiT),原生融合文本描述与连续地理空间元数据(如地面采样距离、经纬度)。为解决大规模训练中的收敛与空间错位问题,我们提出地理语义对齐损失,通过冻结的专家教师网络蒸馏地表结构先验(如地形、城区),在不增加推理开销的前提下约束扩散潜变量轨迹。在全局规模的Git-10M数据集上预训练后,GeoCore-9B展现出强大的下游泛化能力。除了标准生成任务外,我们证明其可有效应用于实际遥感应用,包括极具挑战性的云去除和合成孔径雷达(SAR)到光学图像的跨模态转换。大量评估表明,GeoCore-9B在视觉保真度和地理结构准确性上均建立新基准。
原文摘要 · Abstract (English)
Existing generative models for earth observation (EO) predominantly rely on fine-tuning natural image priors, which limits their scalability and introduces perspective biases that conflict with geospatial constraints. To address this, we introduce GeoCore-9B, a 9-billion-parameter generative foundation model, which is the first of its scale to be trained from scratch exclusively on EO data. Unlike previous EO foundation models, GeoCore-9B is built upon a Flow Matching-based Diffusion Transformer (DiT) and natively conditions generation on text descriptions and continuous geospatial metadata, including ground sample distances, latitudes, and longitudes. To overcome the convergence and spatial disorientation challenges of training at this scale, we propose a Geospatial Semantic Alignment loss. This objective distills structural Earth surface priors (e.g., terrain and urban areas) from a frozen specialist teacher network, constraining the diffusion latent trajectory during training without adding inference overhead. Pre-trained on the global-scale Git-10M dataset, GeoCore-9B demonstrates strong downstream versatility. Beyond standard proxy generative tasks, we show that GeoCore-9B can be effectively adapted for practical EO applications, including highly challenging tasks such as cloud removal and SAR-to-optical cross-modal translation. Extensive evaluations confirm that GeoCore-9B establishes new state-of-the-art performance in both visual fidelity and geographic structural accuracy.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。