生成跨尺度一致的卫星图像金字塔,解决多分辨率拼接难题。
Genesis: A Generative Engine for Hierarchical Satellite Image Synthesis

- 用垂直超分与水平补全双模型协同生成多尺度图像
- 在任意起始种子下实现无缝、统一的多分辨率地图合成
- 适合遥感图像生成与地理空间数据补全研究者使用
地球观测本质上是多尺度的;地理空间任务涵盖不同分辨率,卫星影像以嵌套的瓦片金字塔形式组织,将细节信息包含在大范围覆盖中。然而,现有卫星影像生成模型仅沿单一轴线操作:或局部放大单个瓦片分辨率,或固定尺度扩展影像范围。因此,尚无方法能生成在空间和尺度上全局一致的完整金字塔——高倍率瓦片必须与所细化的粗粒度上下文及相邻瓦片保持一致。针对这一空白,我们提出新任务:多尺度瓦片补全——给定任意位置、缩放级别下的稀疏种子瓦片,合成一个完整的、均匀的四叉树结构,确保跨尺度与跨空间的一致性。为此,我们设计Genesis生成引擎,通过在四叉树上组合两种专用算子实现:垂直超分辨率模型与水平掩码引导外推模型,生成在缩放层级间一致、邻接瓦片间无缝的图像金字塔。每个算子在其子任务上达到当前最优性能,且引擎可从任意初始配置传播稀疏种子,生成无缝多分辨率地图。为评估该任务并基准Genesis,我们构建了dense500数据集——一个覆盖多种地理区域的全观测多尺度金字塔数据集,并配套一套金字塔级评价指标。代码、模型与数据集已开源于https://github.com/mvrl/genesis。
原文摘要 · Abstract (English)
Earth observation is fundamentally multi-scale; geospatial tasks span varied resolutions, and satellite imagery is organized into cascading tile pyramids that nest fine detail within wide coverage. Current generative models of satellite imagery, however, operate along a single axis: they either zoom to enhance a single tile's resolution or pan to extend imagery at a fixed scale. As a result, no existing method produces a complete pyramid that stays consistent across both scale and space, where a high-zoom tile must agree with the coarse context it refines and with the neighbors it meets. Motivated by this gap, we introduce a new task, multi-scale tile completion: given a sparse set of seed tiles at arbitrary zoom levels and positions, synthesize a complete, uniform quadtree that is globally consistent across both scale and space. We approach this task with Genesis, a generative engine that brings both axes together by composing two specialized operators over the quadtree: a vertical super-resolution model and a horizontal mask-based outpainting model, producing pyramids that are consistent across zoom levels and seamless across neighboring tiles. Each operator achieves state-of-the-art results on its subtask, and the engine propagates sparse seeds into seamless, multi-resolution maps from any initial configuration. To evaluate the task and benchmark Genesis, we introduce dense500, a fully observed multi-scale pyramid dataset spanning diverse geographic regions, together with a suite of pyramid-level metrics. Code, models, and our dataset are available at https://github.com/mvrl/genesis.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。