arXiv:2508.19508cs.ROcs.CV2025-08被引 2

用稀疏视角重建苹果树3D模型,精度媲美激光扫描。

DATR: Diffusion-based 3D Apple Tree Reconstruction Framework with Sparse-View

  • 分两阶段:先用传感器和模型生成树掩码,再用扩散模型和重建模型生成3D结构。
  • 在真实与合成数据上均超越现有方法,处理速度提升约360倍。
  • 适合农业数字孪生系统,尤其适用于野外稀疏视角场景。

数字孪生应用通过构建物理资产的高保真虚拟副本,实现了实时监控与机器人仿真。其核心是高几何保真度的3D重建。然而,现有方法在野外条件下表现不佳,尤其是在视角稀疏且存在遮挡时。本研究提出一种两阶段框架DATR,用于从稀疏视图重建苹果树。第一阶段利用机载传感器与基础模型,半自动地从复杂田间图像中生成树掩码;第二阶段将掩码用于过滤多模态数据中的背景信息,并基于单图像进行3D重建。该阶段结合扩散模型与大型重建模型,分别生成多视图与隐式神经场。扩散模型与大重建模型的训练依赖于由Real2Sim数据生成器生成的真实感合成苹果树。框架在真实与合成数据集上进行了评估,真实数据集包含6棵苹果树及实地测量的真值,合成数据集包含结构多样的树木。结果表明,DATR在两类数据上均优于现有方法,实现接近工业级静态激光扫描的域特征估计性能,同时吞吐量提升约360倍,展现出在可扩展农业数字孪生系统中的巨大潜力。

原文摘要 · Abstract (English)

Digital twin applications offered transformative potential by enabling real-time monitoring and robotic simulation through accurate virtual replicas of physical assets. The key to these systems is 3D reconstruction with high geometrical fidelity. However, existing methods struggled under field conditions, especially with sparse and occluded views. This study developed a two-stage framework (DATR) for the reconstruction of apple trees from sparse views. The first stage leverages onboard sensors and foundation models to semi-automatically generate tree masks from complex field images. Tree masks are used to filter out background information in multi-modal data for the single-image-to-3D reconstruction at the second stage. This stage consists of a diffusion model and a large reconstruction model for respective multi view and implicit neural field generation. The training of the diffusion model and LRM was achieved by using realistic synthetic apple trees generated by a Real2Sim data generator. The framework was evaluated on both field and synthetic datasets. The field dataset includes six apple trees with field-measured ground truth, while the synthetic dataset featured structurally diverse trees. Evaluation results showed that our DATR framework outperformed existing 3D reconstruction methods across both datasets and achieved domain-trait estimation comparable to industrial-grade stationary laser scanners while improving the throughput by $\sim$360 times, demonstrating strong potential for scalable agricultural digital twin systems.

3D重建数字孪生扩散模型农业应用

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。