让3D生成模型可解释,通过人类概念控制生成过程。
3D-CBM: A Framework for Concept-Based Interpretability in Generative 3D Modeling

- 用人类定义的概念约束3D生成的隐空间表示。
- 在PartNet/ShapeNet上实现88.8%概念预测准确率,误差仅0.0115。
- 支持生成时交互修正结构错误,适合医疗制造等高可靠性场景。
本研究提出3D-CBM框架,将概念瓶颈模型(CBM)融入3D生成架构,以解决深度几何学习中的固有语义鸿沟。随着深度模型成为3D内容生成的核心,可解释性从附加特性变为医疗、制造等安全关键领域中建立信任与问责的必要条件。CBM通过强制隐表示对齐人类定义的概念,提供内在可解释性,但其在非结构化3D数据上的应用仍鲜有探索。我们设计并验证了正式的3D-CBM架构,能将点云和网格等原始几何输入映射到多层级可解释原型与功能属性体系。框架还识别出适用于概念监督的专用数据集,如PartNet和ShapeNet。3D部件操作的验证实验显示,该框架在概念预测上达到88.8%准确率,切比雪夫距离为0.0115。关键的是,模型支持测试阶段的精确干预,可交互修正结构错误。本工作为语义可控的3D生成奠定基础,并推动人机协同设计系统的进一步研究。
原文摘要 · Abstract (English)
This research introduces a framework for incorporating Concept Bottleneck Models (CBMs) into 3D generative architectures to address the inherent 'semantic gap' in deep geometric learning. As deep models become central to 3D content creation, explainability shifts from a peripheral feature to a fundamental requirement for trust and accountability in safety-critical domains such as healthcare and manufacturing. CBMs provide an intrinsic interpretability solution by constraining latent representations to align with human-defined concepts, yet their application to unstructured 3D data remains largely unexplored. We design, implement, and validate a formal 3D-CBM architecture that maps raw geometric inputs, including point clouds and meshes, into a multi-tiered taxonomy of interpretable primitives and functional attributes. The framework further identifies strategic datasets, such as PartNet and ShapeNet, specialized for concept-based supervision. Experimental results from a 3D part-manipulation proof-of-concept experiment demonstrate the framework's efficacy, achieving a concept prediction accuracy of 88.8\% and a Chamfer Distance of 0.0115. Critically, the model enables precise test-time intervention, allowing for the interactive correction of structural errors. This work establishes a foundation for semantically-steerable 3D generation and invites further exploration into collaborative human-in-the-loop design systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。