arXiv:2607.00417cs.CVcs.AI2026-07被引 1

用物理几何信息让3D模型更好重建卫星多视角影像。

EO-VGGT: Orbital Ray-Conditioned 3D Foundation Models for Satellite Multi-View Reconstruction

论文配图:EO-VGGT: Orbital Ray-Conditioned 3D Foundation Models for Satellite Multi-View Reconstruction
图 1 · 摘自论文原文
  • 通过几何与辐射一致性筛选最优观测图像。
  • 将卫星推扫成像线编码为高维几何令牌。
  • 轻量适配器融合几何信息,提升重建精度。

在卫星星座时代,多视角光学遥感影像对地球观测和高质量数字表面模型(DSM)重建至关重要。尽管前馈式3D基础模型已变革计算机视觉,但在遥感领域受限于隐式透视假设与显式轨道推扫几何之间的结构差异,且视图间异质性显著。本文提出EO-VGGT,通过显式物理几何嵌入,将冻结的透视驱动模型适配至轨道观测。首先,几何-相关性约束选择(GCCS)策略平衡几何多样性与辐射一致性,优化输入序列;其次,传感器射线编码器(SRE)基于有理函数模型(RFM)将像素级推扫视线参数化为高维空间几何令牌,弥合中心投影与轨道运动学的数学差异;最后,轻量级射线指向感知适配器(RPAA)采用门控残差块,直接将这些令牌融入冻结Transformer主干。结果表明,结合显式物理几何与优化视图选择,是实现鲁棒前馈式卫星3D重建的关键。

原文摘要 · Abstract (English)

In the era of satellite constellations, multi-view optical satellite imagery is pivotal for Earth Observation (EO) and high-quality Digital Surface Model (DSM) reconstruction. Although feed-forward 3D foundation models have transformed computer vision, their deployment in satellite remote sensing is inherently constrained by the structural discrepancy between implicit perspective assumptions and explicit orbital pushbroom geometry. This geometric incongruity is further compounded by pronounced view-set heterogeneity. We present EO-VGGT, a framework that adapts a frozen perspective-driven model to orbital observations via explicit physical geometry embedding.First, the Geometry-Correlation Constrained Selection (GCCS) strategy prunes sub-optimal observations by balancing geometric diversity and radiometric consistency to optimize the input sequence. Second, a Sensor-Ray Encoder (SRE) parameterizes pixel-level pushbroom lines of sight derived from the Rational Function Model (RFM) into high-dimensional space-geometric tokens, reconciling the mathematical discrepancy between central projection and orbital kinematics. Third, a lightweight Ray-Pointing-Aware Adapter (RPAA) employs gated residual blocks to integrate these tokens directly into the frozen transformer backbone. Our findings underscore that integrating explicit physical geometry with optimized view selection is essential for robust feed-forward satellite 3D reconstruction.

卫星遥感3D重建几何建模基础模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。