直接优化显式网格,实现高保真三维重建。
ExMesh: Explicit Mesh Reconstruction with Topology Adaptation

- 通过可微分优化与拓扑更新结合,动态调整网格结构。
- 支持实时UV坐标维护,避免纹理失真。
- 首个将离散拓扑操作融入连续优化的框架。
从多视角图像重建表面网格仍是近年核心挑战。现有方法多依赖中间表示与后处理(如Marching Cubes或TSDF融合),常导致伪影和几何断裂。直接优化显式网格虽有潜力,但面临两大难题:如何自适应细化拓扑以捕捉细节而不引入退化面;如何在网格结构演化中保持一致的UV坐标以支持高保真纹理。为此,我们提出ExMesh,一种新框架,通过可微分优化与离散拓扑更新相结合,实现粗粒度到细粒度的优化。具体地,引入自适应顶点分裂与合并策略,配合实时UV维护,确保几何完整性。据我们所知,ExMesh是首个将离散拓扑操作无缝集成到连续可微优化流程中的框架。大量实验表明,ExMesh在精度、计算效率与网格简洁性之间取得良好平衡。
原文摘要 · Abstract (English)
Reconstructing surface meshes from multi-view images has remained a core challenge in recent years. Most existing methods, whether implicit or explicit, depend on intermediate representations and post-processing steps like Marching Cubes or TSDF fusion, often resulting in artifacts and fragmented geometry. Directly optimizing explicit meshes is a promising approach. However, it presents two critical challenges. The first is how to adaptively refine mesh topology to capture detail without introducing degenerate faces. The second is how to maintain consistent UV coordinates for high-fidelity texturing as the mesh structure evolves. To overcome these, we propose ExMesh, a novel framework that directly optimizes explicit meshes by integrating differentiable optimization with discrete topology updates. Specifically, we introduce an adaptive vertex splitting and merging strategy, along with real-time UV maintenance, to enable coarse-to-fine optimization while preserving geometric integrity. To our knowledge, ExMesh is the first framework to seamlessly integrate discrete topology operations into a continuous differentiable optimization pipeline. Extensive experiments demonstrate that ExMesh achieves a balance among accuracy, computational efficiency, and mesh conciseness.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。