用3D高斯表示实现多相动态生成,支持流体、橡胶等复杂交互。
VersaGauss: A Versatile Framework for Generating Multiphase Dynamics with 3D Gaussians

- 基于3D高斯构建统一生成-模拟-渲染框架,支持多相物理交互。
- 提出耦合多相点法,可真实模拟流体、沙子、雪等多种材料互动。
- 适用于影视特效、虚拟现实等需多材质动态模拟的场景。
近期在3D高斯表示用于重建、生成和物理模拟方面取得进展,但现有方法主要聚焦于固体物体的物理驱动动态生成,且仅能处理单相碰撞交互。本文提出VersaGauss,一个统一的生成、模拟与渲染框架,支持多种物理驱动的动态生成,尤其擅长多相交互。系统输入少量图像,即可生成包含多个物体的真实感物理驱动3D动态场景。为优化高斯核分布,设计了粒子剪枝算法;提出耦合多相点法(CMPM)以有效建模和生成多相交互。此外,在CMPM中引入谐波插值及高斯演化策略,实现逼真的流体渲染效果。大量实验表明,该框架可模拟流体、橡胶、沙子、雪等多种材料间的交互。代码已公开于https://github.com/Elowen-surj/VersaGauss。
原文摘要 · Abstract (English)
Recent progress has been made in 3D Gaussian representation for reconstruction, generation, and physical simulation. However, current approaches mainly concentrate on physics-based dynamic generation of solid objects and only handle single-phase collision interactions. We introduce VersaGauss, a unified framework for generation, simulation, and rendering that supports versatile physics-based dynamic generation, particularly for multiphase interactions. Our system takes a few images as input and produces a realistic, physics-driven 3D dynamic scene with multiple objects. To optimize the Gaussian kernel distribution, we develop a particle pruning algorithm. We also propose the Coupled Multiphase Point Method (CMPM) to effectively model and generate multiphase interactions. Additionally, harmonic interpolation within CMPM and a Gaussian evolution strategy are introduced to achieve realistic fluid rendering. Extensive experiments demonstrate that our framework can simulate interactions among various materials such as fluid, rubber, sand, snow, and others. Code is available at https://github.com/Elowen-surj/VersaGauss.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。