用流场建模植物生长,实现连续时间的3D动态渲染。
Grow with the Flow: 4D Reconstruction of Growing Plants with Gaussian Flow Fields
- 将高斯点与神经微分方程结合,构建连续生长流场。
- 在新数据集上实现更优图像质量与几何一致性。
- 适合关注植物生长模拟与4D动态建模的研究者。
建模植物生长过程中的时变3D外观面临独特挑战:与大多数动态场景不同,植物在扩展、分枝和分化过程中持续生成新几何结构。现有动态场景表示方法不适用:变形场约束不足,难以生成物理解释的动态;而4D高斯溅射在不同时间使用不同高斯原语表示同一物理结构,破坏了时间一致性。我们提出GrowFlow,将3D高斯原语与神经常微分方程耦合,将植物生长建模为几何参数(位置、尺度、朝向)上的连续流场。该表示支持一致的外观渲染,并对每个原语实现全时间对应关系,捕捉非线性连续时间生长动态。为初始化足够数量的高斯原语,我们先重建成熟植株,再学习逆向生长过程,有效反演植物发育历史。GrowFlow在新构建的多视角延时摄影数据集上,相比以往方法显著提升图像质量和几何一致性,并首次提供生长3D结构的时序一致表示。
原文摘要 · Abstract (English)
Modeling the time-varying 3D appearance of plants during growth poses unique challenges: unlike most dynamic scenes, plants continuously generate new geometry as they expand, branch, and differentiate. Existing dynamic scene representations are ill-suited to this setting: deformation fields provide insufficient constraints to yield physically plausible scene dynamics, and 4D Gaussian splatting represents the same physical structures with different Gaussian primitives at different times, breaking temporal consistency. We introduce GrowFlow, a dynamic representation that couples 3D Gaussian primitives with a neural ordinary differential equation to model plant growth as a continuous flow field over geometric parameters (position, scale, and orientation). Our representation enables consistent appearance rendering and models nonlinear, continuous-time growth dynamics with full temporal correspondences for every primitive. To initialize a sufficient set of Gaussian primitives, we first reconstruct the mature plant and then learn a reverse-growth process, effectively simulating the plant's developmental history in reverse. GrowFlow achieves superior image quality and geometric coherence compared to prior methods on a new, multi-view timelapse dataset of plant growth, and provides the first temporally coherent representation for appearance modeling of growing 3D structures.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。