解决3D生成中部件身份与位置混淆问题,实现稳定可控的结构化生成。
ISAP-3D: Identity-Slot Aligned Part-Aware 3D Generation

- 通过身份-槽位对齐机制,明确部件与生成槽的对应关系。
- 在多个数据集上实现更稳定的部件分解和更高的生成可控性。
- 适合需要精确部件控制的3D内容生成任务,如工业设计与虚拟场景构建。
部件感知的3D生成旨在合成具有语义意义组件的结构化物体,但常因身份与布局耦合导致结构模糊。现有方法或隐式推断部件身份与空间布局,易引发部件分配不稳定(如槽位互换或部件合并);或依赖难以获取的强布局条件。我们指出此模糊性源于身份-槽位排列自由度:缺乏显式身份-槽位对齐时,训练过程中部件与生成槽的对应关系不可识别,允许多种槽位分配满足相同监督信号,造成分解不一致。基于此,我们提出身份-槽位对齐框架ISAP-3D,通过语义身份令牌锚定每个部件,进行身份条件的一对一布局预测,再进行布局条件的几何生成。结构化的局部-全局条件机制确保身份对齐贯穿语义、空间与几何阶段。同时构建了采用统一语义协议的部件级数据集,支持可学习且一致的身份-槽位对齐。大量实验表明,相比最先进基线,ISAP-3D在结构稳定性、可控性和鲁棒性方面均有显著提升。
原文摘要 · Abstract (English)
Part-aware 3D generation aims to synthesize structured objects with semantically meaningful components, yet often suffers from structural ambiguity due to identity-layout entanglement. Existing methods either infer part identity and spatial layout implicitly, which can lead to unstable part allocation (e.g., slot swapping or part merging), or rely on strong layout conditions that are difficult to obtain in practice. We attribute this ambiguity to identity-slot permutation freedom: without explicit identity-slot alignment, the correspondence between semantic parts and generation slots is not identifiable during training, allowing multiple slot assignments to fit the same supervision and leading to inconsistent decomposition. Based on this insight, we argue that stable part-aware generation requires identity-aligned one-to-one slot modelling. We therefore propose an identity-slot aligned framework, ISAP-3D, which anchors each part with semantic identity tokens and performs identity-conditioned one-to-one layout prediction, followed by layout-conditioned geometry synthesis. Structured local-global conditioning maintains identity alignment across semantic, spatial, and geometric stages. We also construct a part-level dataset with a unified semantic protocol to enable learnable and consistent identity-slot alignment. Extensive experiments demonstrate improved structural stability, controllability, and robustness over state-of-the-art part-aware generation baselines.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。