arXiv:2602.20539eess.IVcs.CV2026-02

通过分阶段优化,提升无人机森林中树木分支的3D重建精度。

Progressive Per-Branch Depth Optimization for DEFOM-Stereo and SAM3 Joint Analysis in UAV Forestry Applications

  • 分步融合深度估计与分割,逐步消除噪声和误差
  • 使分支深度标准差降低82%,保持边缘清晰度
  • 适合需要精准三维建模的无人植保系统研究

精确的单枝三维重建是实现无人机自主修剪的前提;然而,现代立体匹配器生成的密集视差图在复杂林冠中仍过于嘈杂,难以用于单枝分析。本文提出一种渐进式流程,集成DEFOM-Stereo基础模型视差估计、SAM3实例分割与多阶段深度优化,生成鲁棒的单枝点云。从基础方案出发,系统识别并逐次解决三类误差:首先通过形态学腐蚀及保留骨架的变体修复掩码边界污染,保护细枝拓扑;其次结合LAB空间马氏距离颜色验证与跨枝重叠仲裁缓解分割误差;最后针对最顽固的深度噪声,先经异常值剔除与中值滤波预处理,再采用五阶段方案——全局MAD检测、空间密度一致性、局部MAD滤波、RGB引导滤波与自适应双边滤波。在新西兰坎特伯雷地区使用ZED Mini相机(63 mm基线)获取的1920x1080分辨率辐射松(Pinus radiata)立体图像上评估,该方法将平均单枝深度标准差降低82%,同时保持边缘保真度,生成几何一致的3D点云,适用于自主修剪工具定位。所有代码与处理数据均已公开,推动无人机林业研究发展。

原文摘要 · Abstract (English)

Accurate per-branch 3D reconstruction is a prerequisite for autonomous UAV-based tree pruning; however, dense disparity maps from modern stereo matchers often remain too noisy for individual branch analysis in complex forest canopies. This paper introduces a progressive pipeline integrating DEFOM-Stereo foundation-model disparity estimation, SAM3 instance segmentation, and multi-stage depth optimization to deliver robust per-branch point clouds. Starting from a naive baseline, we systematically identify and resolve three error families through successive refinements. Mask boundary contamination is first addressed through morphological erosion and subsequently refined via a skeleton-preserving variant to safeguard thin-branch topology. Segmentation inaccuracy is then mitigated using LAB-space Mahalanobis color validation coupled with cross-branch overlap arbitration. Finally, depth noise - the most persistent error source - is initially reduced by outlier removal and median filtering, before being superseded by a robust five-stage scheme comprising MAD global detection, spatial density consensus, local MAD filtering, RGB-guided filtering, and adaptive bilateral filtering. Evaluated on 1920x1080 stereo imagery of Radiata pine (Pinus radiata) acquired with a ZED Mini camera (63 mm baseline) from a UAV in Canterbury, New Zealand, the proposed pipeline reduces the average per-branch depth standard deviation by 82% while retaining edge fidelity. The result is geometrically coherent 3D point clouds suitable for autonomous pruning tool positioning. All code and processed data are publicly released to facilitate further UAV forestry research.

三维重建无人机点云优化林业应用

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。