通过减法生成3D部件,让物体拆解更自然、结构更完整。
SCULPT: Subtractive Composition for 3D Part Generation

- 用联合分割预测器逐次切除部件,同步生成剩余部分。
- 在多个数据集上实现最优几何质量,部件拼合后仍保持完整形状。
- 适合需要精细拆解与编辑的3D建模场景,如动画与材质替换。
面向部件感知的3D生成旨在创建整体一致且可分解的数字资产,便于编辑、材质分配、动画和复用。现有方法将结构施加于生成流程之外:基于分割的方法在生成后划分形状,添加式方法则从预设布局合成部件再拼接,前者固定生成形态但无法预先确定部件边界,后者虽暴露部件数量却常导致边界间隙、穿插和材质不连续。本文提出SCULPT,一种通过减法组合解决上述问题的框架。给定结构化3D隐空间中的完整对象,SCULPT迭代应用联合分裂预测器,同时生成一个被提取部件及其剩余部分。该预测器在图像和当前3D状态联合条件下执行耦合去噪,使部件与余下部分同步生成而非后期拼合。其处理在两者原始稀疏3D支持的并集上,允许邻近支持重叠,而非强制离散体素划分。当剩余支持为空或达到安全上限时停止迭代,使部件数量自适应地受限于该边界内。大量实验表明,该方法在PartObjaverse上达到最先进的几何表现,且部件组装后仍保持强整体重建能力。对四个数据集图像、一个文本生成图像及一个真实照片的测试进一步展示了超越基准的细粒度纹理部件分解能力。
原文摘要 · Abstract (English)
Part-aware 3D generation aims to create digital assets that are coherent as complete objects while exposing structural parts for editing, material assignment, animation, and reuse. Existing methods impose this structure outside the native generation loop: segmentation-based methods partition an already generated shape, while additive methods synthesize parts from predefined layouts, boxes, or tokens and then reconcile them into a whole. The former preserves the generated geometry but fixes the object before part boundaries are determined; the latter exposes part cardinality but often leaves shared boundaries vulnerable to gaps, interpenetrations, and material discontinuities. In this paper, we propose SCULPT, a framework that addresses these challenges through subtractive composition. Given a complete object represented in a structured 3D latent space, SCULPT iteratively applies a joint split predictor to generate one extracted part together with the remaining object. The predictor performs a coupled denoising process conditioned on both the image and the current 3D state, so the extracted part and updated remainder are generated together rather than reconciled after generation. The joint split predictor processes both outputs on the union of their native sparse 3D supports, allowing neighboring supports to overlap rather than imposing a disjoint voxel partition. The rollout ends when the remainder support becomes empty or reaches a fixed safety cap, allowing the number of generated parts to adapt to each object within that bound. Extensive experiments demonstrate state-of-the-art geometry on PartObjaverse while preserving strong complete-object reconstruction after part assembly. Results on four dataset images, one text-to-image-generated input, and one real-world photograph further show fine-grained textured part decomposition beyond the benchmark.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。