arXiv:2607.11588cs.CV2026-07中稿 · ECCV被引 2

提出FoundationGeo框架,实现单目几何的度量一致性建模。

FoundationGeo: Learning Spatial Pixel-Wise Fields for Monocular Metric Geometry

论文配图:FoundationGeo: Learning Spatial Pixel-Wise Fields for Monocular Metric Geometry
图 1 · 摘自论文原文
  • 分两阶段学习:先建高保真仿射不变几何模型,再引入像素级校准场提升度量精度。
  • 在7个基准上零样本测试表现领先,平均优于重模型5.2%以上。
  • 解决相机内参不匹配问题,通过合成数据增强焦距覆盖范围。

我们提出FoundationGeo,一种两阶段框架,通过空间校准和合理数据设计显式连接相对与度量预测。第一阶段基于DINOv3初始化,在1020万样本的多领域语料库上训练,辅以局部细节监督,生成边界清晰、跨域泛化能力强的仿射不变几何模型。第二阶段引入轻量级像素级校准场进行度量估计:一个空间变化的尺度场用于对齐度量,一个射线方向修正场缓解点图几何中的方向偏差,共同生成度量一致的三维点图。此外,我们发现相机内参覆盖不足(特别是焦距分布不匹配)是零样本度量泛化的关键瓶颈——当测试内参超出训练分布时性能急剧下降。为此,我们利用Blender构建的数据引擎,在多种焦距下合成额外训练数据,修复内参覆盖不足问题,显著提升内参偏移下的鲁棒性。在七个基准上的大量零样本评估表明,FoundationGeo显著增强了跨域鲁棒性,在多样化场景中保持稳定领先,避免了其他方法常见的性能骤降,整体表现最优,平均超越更重基线5.2%以上。

原文摘要 · Abstract (English)

We present FoundationGeo, a two-stage framework that explicitly bridges relative and metric prediction via spatial calibration and principled data design. Stage 1 learns a high-fidelity, affine-invariant geometry model by initializing with DINOv3 and training on a curated 10.2M-sample multi-domain corpus with complementary local-detail supervision, yielding sharp boundaries and strong cross-domain generalization. Stage 2 moves beyond global scaling by introducing lightweight pixel-wise calibration fields for metric estimation: a scale field for spatially varying metric alignment and a ray-direction correction field that mitigates directional bias in point-map geometry, together producing metrically consistent 3D point maps. Beyond model design, we identify camera intrinsic coverage, especially focal length distribution mismatch between training and test data, as a key bottleneck for zero-shot metric generalization: performance drops sharply when test intrinsics fall outside the training distribution. To address this, we synthesize additional training data across diverse focal lengths using a Blender-based data engine, repairing under-covered focal regimes and improving robustness under intrinsic shift. Extensive zero-shot evaluations across seven benchmarks show that FoundationGeo significantly strengthens cross-domain robustness, staying near the top across diverse domains while avoiding the sharp cross-domain performance drops observed in other methods. This consistency translates into the best overall performance, surpassing heavier baselines by over 5.2% on average.

单目几何度量重建像素级校准跨域泛化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。