arXiv:2410.10399cs.CV2024-10被引 2

用可微模板参数化3D形状结构,实现细节丰富的生成与插值

Parameterize Structure with Differentiable Template for 3D Shape Generation

  • 用固定长度参数+可微模板生成立方体结构,统一表达同类物体
  • 通过三视图边界刻画立方体内细节,支持复杂形状重建
  • 模型简洁高效,适合生成带语义的多样化3D形状

结构表示对重建和生成具有部件语义的可编辑3D形状至关重要。现有3D生成方法依赖复杂的网络和层级标注,对部件内部细节关注不足。本文提出一种方法:利用可微模板参数化同一类别的共享结构,通过固定长度参数生成指示具体形状的立方体,并利用每个立方体的三视图边界进一步描述内部细节。形状由参数与立方体内的三视图细节共同表示,由此可计算SDF以恢复物体。得益于固定长度参数与三视图细节,我们的重建与生成网络结构简单且学习有效。方法可在点云重建、生成和插值任务中生成具有复杂细节的多样化形状,并实现平滑插值。大量实验验证了该方法在重建、生成与插值上的优越性。

原文摘要 · Abstract (English)

Structural representation is crucial for reconstructing and generating editable 3D shapes with part semantics. Recent 3D shape generation works employ complicated networks and structure definitions relying on hierarchical annotations and pay less attention to the details inside parts. In this paper, we propose the method that parameterizes the shared structure in the same category using a differentiable template and corresponding fixed-length parameters. Specific parameters are fed into the template to calculate cuboids that indicate a concrete shape. We utilize the boundaries of three-view drawings of each cuboid to further describe the inside details. Shapes are represented with the parameters and three-view details inside cuboids, from which the SDF can be calculated to recover the object. Benefiting from our fixed-length parameters and three-view details, our networks for reconstruction and generation are simple and effective to learn the latent space. Our method can reconstruct or generate diverse shapes with complicated details, and interpolate them smoothly. Extensive evaluations demonstrate the superiority of our method on reconstruction from point cloud, generation, and interpolation.

3D生成可微模板结构表示形状插值

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。