arXiv:2503.21732cs.CV2025-03ICCV被引 80

用稀疏结构实现高分辨率任意拓扑3D建模,直接从渲染损失训练。

SparseFlex: High-Resolution and Arbitrary-Topology 3D Shape Modeling

  • 基于稀疏体素的等值面表示,仅计算表面邻近区域。
  • 1024³分辨率下重建误差降低82%,F-score提升88%。
  • 支持开曲面与内部结构重建,适合生成高质量3D形状。

生成具有任意拓扑(包括开曲面和复杂内部结构)的高保真3D网格仍是重大挑战。现有隐式场方法常需代价高昂且破坏细节的闭合转换,其他方法则难以处理高分辨率。本文提出SparseFlex,一种新型稀疏结构等值面表示,可直接从渲染损失实现高达$1024^3$分辨率的可微网格重建。SparseFlex结合Flexicubes的精度与稀疏体素结构,聚焦表面邻近区域,高效处理开曲面。关键在于提出视锥感知分段体素训练策略,仅激活渲染相关体素,大幅降低内存消耗,首次实现仅用渲染监督重建网格内部。在此基础上,我们构建完整建模流程,训练变分自编码器(VAE)与修正流变换器,实现高质量3D形状生成。实验表明,相比此前方法,切比雪夫距离降低约82%,F-score提升约88%,并成功生成高分辨率、细节丰富的任意拓扑3D形状。SparseFlex通过实现高分辨率、可微网格重建与生成,显著推进3D形状表征与建模的前沿水平。

原文摘要 · Abstract (English)

Creating high-fidelity 3D meshes with arbitrary topology, including open surfaces and complex interiors, remains a significant challenge. Existing implicit field methods often require costly and detail-degrading watertight conversion, while other approaches struggle with high resolutions. This paper introduces SparseFlex, a novel sparse-structured isosurface representation that enables differentiable mesh reconstruction at resolutions up to $1024^3$ directly from rendering losses. SparseFlex combines the accuracy of Flexicubes with a sparse voxel structure, focusing computation on surface-adjacent regions and efficiently handling open surfaces. Crucially, we introduce a frustum-aware sectional voxel training strategy that activates only relevant voxels during rendering, dramatically reducing memory consumption and enabling high-resolution training. This also allows, for the first time, the reconstruction of mesh interiors using only rendering supervision. Building upon this, we demonstrate a complete shape modeling pipeline by training a variational autoencoder (VAE) and a rectified flow transformer for high-quality 3D shape generation. Our experiments show state-of-the-art reconstruction accuracy, with a ~82% reduction in Chamfer Distance and a ~88% increase in F-score compared to previous methods, and demonstrate the generation of high-resolution, detailed 3D shapes with arbitrary topology. By enabling high-resolution, differentiable mesh reconstruction and generation with rendering losses, SparseFlex significantly advances the state-of-the-art in 3D shape representation and modeling.

3D建模稀疏结构可微渲染任意拓扑

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。