arXiv:2607.17967cs.CV2026-07被引 2

解决单目三维重建细节模糊问题,通过3D空间精修提升细粒结构还原精度。

MoGe-3: Fine-Detail Monocular Geometry Estimation with Self-Guided Sparse Volumetric Refinement

论文配图:MoGe-3: Fine-Detail Monocular Geometry Estimation with Self-Guided Sparse Volumetric Refinement
图 1 · 摘自论文原文
  • 将2D图像特征重映射到3D稀疏体素空间,基于真实空间邻近性进行特征聚合。
  • 在多个数据集上显著提升细长结构和小物体的重建精度,点云更贴近真实几何。
  • 适合需要高保真三维重建的场景,如工业质检、文化遗产数字化。

单目三维几何估计在多种场景中已取得显著进展,但当前先进模型在细部结构(如细长物体、小物体)仍存在明显失真。我们归因于架构不匹配:多数模型在二维参数化空间中解码三维几何,特征交互依赖图像平面距离而非真实三维空间关系,导致不同深度表面的特征混叠,造成过度平滑。本文提出MoGe-3,一种具备自引导稀疏体素精修(SSR)的细细节单目几何估计模型,将粗略点图从基础模型迁移到稀疏体素壳,并通过基于3D空间局部性的稀疏卷积进行精修,避免跨深度不连续区域的特征混合。大量实验表明,MoGe-3在多个数据集上显著优于现有方法,在定量指标与定性视觉效果上均实现对细部三维几何的更好恢复。

原文摘要 · Abstract (English)

Monocular geometry estimation has recently achieved impressive performance across diverse scenes. However, state-of-the-art models still face notable distortion in local 3D structure, especially in fine details, like thin structures and small objects. We attribute this limitation to an architectural mismatch: most current models decode 3D geometry within a 2D parameterization, where feature interactions are governed by image-plane proximity rather than true 3D spatial relationships. This inadvertently mixes features from geometrically distant surfaces, resulting in over-smoothed geometry particularly around thin or elongated structure. In this paper, we propose MoGe-3, a fine-detail monocular geometry estimation model with Self-Guided Sparse 3D Refinement (SSR) that lifts monocular geometry modeling from 2D image space to 3D space for high-fidelity metric-scale point maps. MoGe-3 lifts the coarse point map from a foundation base model onto a sparse voxel shell and refines it via SSR. The SSR employs sparse convolutions that aggregate features based on 3D spatial locality, avoiding feature mixing across depth discontinuities. Extensive experiments on diverse datasets demonstrate that MoGe-3 significantly outperforms existing approaches in recovering fine detailed 3D geometry across both quantitative metrics and qualitative visualizations. Project page: https://qft-333.github.io/moge3page/

三维重建单目估计稀疏体素几何精修

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。