arXiv:2505.15528cs.CVcs.GR2025-05ICCV被引 6

用扩散模型生成更逼真的3D植物,支持合成与真实点云增强。

PlantDreamer: Achieving Realistic 3D Plant Models with Diffusion-Guided Gaussian Splatting

  • 结合深度ControlNet与低秩适配,提升纹理与几何精度。
  • 在文本到3D生成中实现更高保真度的植物模型,优于现有方法。
  • 适合植物表型分析、3D数据增强等科研场景使用。

近年来,人工智能在生成合成3D物体方面取得显著进展,但复杂物体如植物的生成仍面临挑战。现有生成式3D模型在植物生成上表现不如通用物体,限制了其在植物分析工具中的应用,后者需要精细细节与准确几何结构。本文提出PlantDreamer,一种新型3D合成植物生成方法,可实现比现有文本到3D模型更真实的复杂植物几何与纹理。该方法采用深度ControlNet、微调的低秩适配(LoRA)以及自适应高斯剔除算法,直接提升生成模型的纹理真实感与几何完整性。此外,PlantDreamer支持纯合成植物生成(基于L-System生成网格)和真实植物点云的增强(转换为3D高斯泼溅)。通过与先进文本到3D模型对比评估,结果表明PlantDreamer在生成高保真合成植物方面表现更优。实验显示,该方法不仅推动了合成植物生成技术的发展,还助力老旧点云数据集的升级,是3D表型分析中的有力工具。

原文摘要 · Abstract (English)

Recent years have seen substantial improvements in the ability to generate synthetic 3D objects using AI. However, generating complex 3D objects, such as plants, remains a considerable challenge. Current generative 3D models struggle with plant generation compared to general objects, limiting their usability in plant analysis tools, which require fine detail and accurate geometry. We introduce PlantDreamer, a novel approach to 3D synthetic plant generation, which can achieve greater levels of realism for complex plant geometry and textures than available text-to-3D models. To achieve this, our new generation pipeline leverages a depth ControlNet, fine-tuned Low-Rank Adaptation and an adaptable Gaussian culling algorithm, which directly improve textural realism and geometric integrity of generated 3D plant models. Additionally, PlantDreamer enables both purely synthetic plant generation, by leveraging L-System-generated meshes, and the enhancement of real-world plant point clouds by converting them into 3D Gaussian Splats. We evaluate our approach by comparing its outputs with state-of-the-art text-to-3D models, demonstrating that PlantDreamer outperforms existing methods in producing high-fidelity synthetic plants. Our results indicate that our approach not only advances synthetic plant generation, but also facilitates the upgrading of legacy point cloud datasets, making it a valuable tool for 3D phenotyping applications.

3D生成植物建模扩散模型点云增强

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。