让3D高斯点云既真实又会“动”,能倒水还能飞。
PG-3DGS: Optimizing 3D Gaussian Splatting to Satisfy Physics Objectives

- 用可微分物理模拟引导高斯点云优化,兼顾视觉与物理行为。
- 生成的茶壶能倒液体,飞机能产生升力,且图像质量不下降。
- 适合需要物理功能的真实3D建模场景,如工业设计、虚拟测试。
高斯点云技术虽能快速生成高保真3D场景,但仅关注视觉效果,缺乏对物体物理行为的理解。本文提出物理引导的3D高斯点云(PG-3DGS),将可微分物理模拟与3D高斯表示结合,生成兼具视觉真实性和物理功能性的三维结构。通过在优化过程中引入物理目标函数,模型可学习调整形状,使生成对象具备真实物理行为,如茶壶可倾倒液体、飞机可产生升力,同时保持高质量视觉表现。在倒液和气动升力任务中,PG-3DGS显著提升物理功能性,且在相同气流条件下,3D打印的赛斯纳、B-2隐形轰炸机和纸飞机实测显示其升力均高于外观匹配基线。该框架统一了基于外观的重建与基于物理的推理,实现从外观到功能的端到端3D结构生成。
原文摘要 · Abstract (English)
Recent advances in Gaussian Splatting have enabled fast, high-fidelity 3D scene generation, yet these methods remain purely visual and lack an understanding of how shapes behave in the physical world. We introduce Physics-Guided 3D Gaussian Splatting (PG-3DGS), a framework that couples differentiable physics simulation with 3D Gaussian representations to generate 3D structures satisfying physics functionalities. By allowing physical objectives to guide the shape optimization process alongside visual losses, our approach produces geometries that are not only photometrically accurate but also physically functional. The model learns to adjust shapes so that the generated objects exhibit physically meaningful behaviors, for example, teapots that can pour and airplanes that can generate lift, without sacrificing visual quality. Experiments on pouring and aerodynamic lift tasks show that PG-3DGS improves physical functionality while preserving visual quality. In addition to simulation gains, bench-top physical lift tests with 3D-printed aircraft (Cessna, B-2 Spirit, and paper plane) under identical airflow conditions show higher scale-measured lift for PG-3DGS, generated structures than an appearance-matching baseline in all three cases. Our unified framework connects appearance-based reconstruction with physics-based reasoning, enabling end-to-end generation of 3D structures that both look realistic and function correctly.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。