Sat3R用卫星影像特性微调深度模型,实现快速高精度数字表面建模。
Sat3R: Satellite DSM Reconstruction via RPC-Aware Depth Fine-tuning

- 基于RPC几何构建伪深度监督,微调深度模型适应卫星影像
- 在DFC2019上比零样本方法MAE降低38%,速度提升300倍以上
- 适合需要快速大范围卫星地形重建的场景
从卫星影像中精确重建数字表面模型(DSM)对灾害响应、城市规划和大规模地理制图至关重要。现有方法存在根本矛盾:基于优化的方法精度高但每场景需数小时计算,通用几何基础模型推理快但因理性多项式相机(RPC)模型引入的领域差异和深度尺度分布不匹配,无法泛化到卫星影像。我们提出Sat3R,一种前馈框架,通过使用尺度不变对数(SiLog)损失对Depth Anything V2进行感知RPC的度量深度微调,利用RPC几何构建物理一致的伪深度监督,使单目深度基础模型无需每场景优化即可适配卫星域。在DFC2019基准测试中,Sat3R相比零样本前馈基线将平均绝对误差(MAE)降低38%,且精度媲美基于优化的方法,同时实现超过300倍的速度提升。结果表明,经适当适配的前馈模型可在极低计算成本下达到优化方法的精度,为实用的大规模卫星DSM重建铺平道路。
原文摘要 · Abstract (English)
Accurate Digital Surface Model (DSM) reconstruction from satellite imagery is critical for applications such as disaster response, urban planning, and large-scale geographic mapping. Existing approaches face a fundamental trade-off: optimization-based methods achieve strong accuracy but require hours of per-scene computation, while generalizable geometry foundation models offer near-instant inference but fail to generalize to satellite imagery due to the domain gap introduced by the Rational Polynomial Camera (RPC) model and mismatched depth scale distributions. We present Sat3R, a feed-forward framework that bridges this gap via RPC-aware metric depth fine-tuning of Depth Anything V2 using the Scale-Invariant Logarithmic (SiLog) loss. By constructing physically consistent pseudo depth supervision from RPC geometry, Sat3R adapts a monocular depth foundation model to the satellite domain without per-scene optimization. Experiments on the DFC2019 benchmark demonstrate that Sat3R reduces MAE by 38% over zero-shot feed-forward baselines and achieves competitive accuracy against optimization-based methods, while delivering over 300x speedup. Sat3R demonstrates that feed-forward models, when properly adapted to the satellite domain, can match optimization-based accuracy at a fraction of the computational cost, paving the way for practical large-scale satellite DSM reconstruction.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。