SOPHY可生成带物理材质的3D物体,直接用于仿真环境。
SOPHY: Learning to Generate Simulation-Ready Objects with Physical Materials
- 联合生成形状、纹理与物理材质属性
- 提升生成物体的仿真真实度与动态合理性
- 适合交互式场景与物理模拟应用
我们提出SOPHY,一种用于3D物理感知形状合成的生成模型。与仅关注静态几何或生成无物理依据动画的现有3D生成模型不同,本方法联合生成与物理动力学相关的形状、纹理和材料属性,使生成物体可直接用于仿真与互动动态环境。为训练模型,我们构建了一个包含详细物理材料属性标注的3D物体数据集,并设计了高效的材料标注流程。该方法支持文本驱动生成交互式物理感知3D物体,以及单图像重建物理合理的形状。实验表明,联合建模形状与材料属性显著提升了生成形状的真实感与保真度,在生成几何与物理合理性任务上均取得更好性能。
原文摘要 · Abstract (English)
We present SOPHY, a generative model for 3D physics-aware shape synthesis. Unlike existing 3D generative models that focus solely on static geometry or 4D models that produce physics-agnostic animations, our method jointly synthesizes shape, texture, and material properties related to physics-grounded dynamics, making the generated objects ready for simulations and interactive, dynamic environments. To train our model, we introduce a dataset of 3D objects annotated with detailed physical material attributes, along with an efficient pipeline for material annotation. Our method enables applications such as text-driven generation of interactive, physics-aware 3D objects and single-image reconstruction of physically plausible shapes. Furthermore, our experiments show that jointly modeling shape and material properties enhances the realism and fidelity of the generated shapes, improving performance on both generative geometry and physical plausibility.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。