从多视角图像直接重建可模拟的城市级完整网格,精度高且可扩展。
City-Mesh3R: Simulation-Ready City-Scale 3D Mesh Reconstruction from Multi-View Images

- 分治策略:先聚类图像建拓扑地图,再分区选相机做密集重建
- 生成闭合、规则、带细节的3D网格,支持任意规模城市重建
- 适合需要真实感3D场景的自动驾驶仿真与数字孪生应用
从多视角图像进行城市级3D表面重建以支持下游3D仿真,面临场景规模大、结构复杂等挑战。基于NeRF、Gaussian Splatting等现有方法常因几何缺失、表面不规则或噪声而无法生成适用于仿真的3D网格。将小规模重建方法扩展至大规模城市场景在计算上不可行。本文提出City-Mesh3R,一种可扩展的端到端框架,可直接从大规模无序图像集合重建封闭表面网格。不同于以往需全局稀疏SfM点云初始化并分布式稠密重建的方法,本方法采用图像聚类构建拓扑城市地图,分簇独立进行稀疏SfM并合并,避免全量特征匹配。随后按空间分区进行曲率感知相机选择,执行稠密表面重建与自适应顶点密度重网格化以优化表面。最终将分区网格拼接生成全局城市网格。在城市级重建数据集上的评估表明,该方法生成高保真、闭合、几何规则的3D网格,能捕捉精细表面细节,且因在分布式环境中端到端处理,具备向任意大规模场景扩展的能力。
原文摘要 · Abstract (English)
City-scale 3D surface reconstruction from multiview images for downstream 3D simulation, poses highly challenging problems due to the scale and complexity of urban scenes. Existing city-scale 3D reconstruction methods based on NeRF, Gaussian Splatting etc. often fail to recover 3D meshes ready for simulation due to incomplete/missing geometry and irregular, noisy surfaces. Scaling existing small-scale 3D reconstruction methods to arbitrarily large urban scenes is highly infeasible due to their computational complexity. We present City-Mesh3R, a scalable framework for reconstructing watertight surface meshes directly from large unordered image collections. Unlike recent methods which use global sparse SfM point-cloud initialization followed by a distributed 3D dense reconstruction of large-scale scenes, our method follows an end-to-end images-to-mesh 3D reconstruction approach using a divide-and-conquer strategy. The sparse city map is reconstructed via topological image clustering, cluster-wise independent sparse SfM and map merging, without need for exhaustive image feature matching. Then this map is partitioned spatially to perform geometry-aware camera selection, followed by dense surface reconstruction and surface refinement using curvature-aware adaptive vertex density remeshing. These partition meshes are then stitched together to produce the global mesh of the city. The proposed end-to-end framework is evaluated on city-scale reconstruction datasets. As demonstrated by our qualitative and quantitative results, our proposed method yields high-fidelity watertight 3D meshes with regular geometry, capturing fine surface details, and is suitable for scaling to arbitrarily large scenes owing to the end-to-end processing in a distributed setting.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。