arXiv:2507.13346cs.CV2025-07NeurIPS被引 36

自动逐个生成3D物体部件,输入图像或3D模型即可重建完整物体。

AutoPartGen: Autogressive 3D Part Generation and Discovery

  • 基于潜空间逐个生成3D部件,边生成边根据已有部件调整。
  • 在3D部件生成任务上达到当前最佳性能,能自适应决定部件数量与类型。
  • 适合需要可解释性3D生成的场景,如设计辅助或逆向工程。

我们提出AutoPartGen,一种以自回归方式生成由3D部件组成的物体的模型。该模型可接收物体图像、部件2D掩码或现有3D物体作为输入,生成对应的组合式3D重建。方法基于3DShape2VecSet这一具有强几何表达能力的潜在3D表示,发现其潜在空间具备显著组合性,特别适合部件级生成任务。AutoPartGen以自回归方式逐个预测部件,每次生成均依赖已生成部件及额外输入(如2D图像、掩码或3D物体),直至模型判断所有部件已生成,从而自动确定部件类型与数量。生成的部件可无缝组装为连贯物体或场景,无需额外优化。我们在整体3D生成能力和部件级别生成质量上评估了AutoPartGen,结果表明其在3D部件生成任务中达到最先进水平。

原文摘要 · Abstract (English)

We introduce AutoPartGen, a model that generates objects composed of 3D parts in an autoregressive manner. This model can take as input an image of an object, 2D masks of the object's parts, or an existing 3D object, and generate a corresponding compositional 3D reconstruction. Our approach builds upon 3DShape2VecSet, a recent latent 3D representation with powerful geometric expressiveness. We observe that this latent space exhibits strong compositional properties, making it particularly well-suited for part-based generation tasks. Specifically, AutoPartGen generates object parts autoregressively, predicting one part at a time while conditioning on previously generated parts and additional inputs, such as 2D images, masks, or 3D objects. This process continues until the model decides that all parts have been generated, thus determining automatically the type and number of parts. The resulting parts can be seamlessly assembled into coherent objects or scenes without requiring additional optimization. We evaluate both the overall 3D generation capabilities and the part-level generation quality of AutoPartGen, demonstrating that it achieves state-of-the-art performance in 3D part generation.

3D生成自回归部件分解可组合

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。