arXiv:2605.18667cs.CVcs.LG2026-05

通过融合多个地球嵌入模型,提升地理信息任务表现。

Better Together: Evaluating the Complementarity of Earth Embedding Models

论文配图:Better Together: Evaluating the Complementarity of Earth Embedding Models
图 1 · 摘自论文原文
  • 提出互补性评估方法,衡量不同嵌入模型融合后的增益。
  • 四组模型组合在六项任务中四项超越单模型最佳表现。
  • 互补性受任务类型和土地覆盖尺度影响,适合多模型协作场景。

地球嵌入模型将地球观测数据转化为与地球表面位置紧密关联的嵌入向量。当前评估通常孤立进行,仅比较不同嵌入在下游任务中的表现。然而,空间对齐的嵌入可自然融合,为每个位置提供更丰富信息,而孤立评估无法捕捉此能力。为此,我们提出基于互补性的评估范式:融合嵌入相对于最优单模型基线的性能提升。为实现该目标,引入适用于任意嵌入与任务的嵌入互补性指数,并在六项下游任务中评估四个地球嵌入模型(AlphaEarth、Tessera、GeoCLIP、SatCLIP)的单独、成对及联合表现。结果显示,融合嵌入在六项任务中的四项优于最优单模型,证实孤立评估常低估嵌入能力。互补性具有任务与位置依赖性;在土地覆盖回归任务中,其部分由土地覆盖类别的空间尺度决定。互补性重新定义了地球嵌入:未来最大提升可能不来自单一模型,而是来自协同作用更强的组合。

原文摘要 · Abstract (English)

Earth embedding models transform Earth observation data into embeddings uniquely tied to locations on the Earth's surface. These models are typically evaluated in isolation, comparing the downstream task performance across different Earth embeddings. However, spatially aligned embeddings can naturally be fused, providing richer information per location, a capability that isolated evaluations fail to capture. We therefore propose assessing Earth embeddings by their complementarity: the performance gain of fused embeddings over the best single-model baseline. To operationalise this, we introduce an embedding complementarity index applicable to any embedding and task, and evaluate four Earth embedding models (AlphaEarth, Tessera, GeoCLIP, SatCLIP) in isolation, in all pairs, and jointly across six downstream tasks. Fused embeddings outperform the best single model in four out of six tasks, confirming that single-embedding evaluations often underestimate Earth embedding capabilities. Complementarity proves both task- and location-dependent. Further, for a land cover regression task, we find that complementarity is partially determined by the spatial scale of land cover classes. Complementarity reframes Earth embeddings: the greatest future gains may come not from any single Earth embedding model, but from combinations that are better together.

地球嵌入多模型融合遥感分析互补性评估

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。