提出卫星多视角图像几何一致评估协议,解决匹配误导问题。
Geometric Consistency Protocol for Foundation Model Features in Multi-View Satellite Imagery

- 基于RPC模型构建三维一致性度量与几何约束匹配代理
- 发现语义相似性与几何定位可解耦,高相似未必可靠匹配
- 验证主流2D模型在几何约束下仍具竞争力,适合遥感领域研究者
标准化评估协议对遥感领域至关重要,尤其当基础特征在不同传感器和复杂成像几何间迁移时。传统多视角重建评估依赖无约束的二维全局匹配,常产生误导。有理函数模型(RFM)及其有理多项式系数(RPC)定义了高度相关的曲线状视差几何,使平面二维搜索空间在物理上不一致。本文提出一种针对RPC框架的几何保真、可复现评估协议。方法结合RPC投影的三维一致性度量与几何约束的密集匹配代理,评估相似性响应在物理合理的搜索流形下是否保持局部唯一。联合报告的关键发现是:跨视角相似性与几何定位可解耦——投影三维点处的高相似性并不保证实际推理中的可靠匹配。基准测试表明,引入几何约束是卫星影像问题定义的基础。此外,即使在该RPC一致性评估下,现有先进2D主干网络仍显著优于专用3D感知模型。
原文摘要 · Abstract (English)
Standardized evaluation protocols are indispensable for robust benchmarking in remote sensing, particularly as foundation features are increasingly transferred across diverse sensors and complex imaging geometries. In satellite multi-view reconstruction, conventional evaluations relying on unconstrained 2D global matching are often misleading. The Rational Function Model (RFM) and its Rational Polynomial Coefficients (RPC) dictate a curved, height-dependent epipolar geometry that render flat 2D search spaces physically inconsistent. We propose a geometry-faithful and reproducible protocol tailored for the RPC framework. Our approach integrates an RPC-projected 3D consistency metric with a geometry-constrained dense matching proxy, specifically evaluating whether similarity responses remain localized and unique under physically plausible search manifolds. A pivotal finding of our joint reporting strategy is the decoupling of semantic agreement and geometric localization: high cross-view similarity at a projected 3D point does not guarantee reliable matchability in practical inference. Our benchmark demonstrates that incorporating geometric constraints is fundamental to the problem definition in satellite imagery. Furthermore, we show that state-of-the-art 2D backbones remain remarkably competitive against specialized 3D-aware models when subjected to this RPC-consistent evaluation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。