arXiv:2601.22861cs.CVcs.CY2026-01被引 1

仅用普通相机拍的图片,就能重建出密林下的真实地面景象。

Under-Canopy Terrain Reconstruction in Dense Forests Using RGB Imaging and Neural 3D Reconstruction

  • 基于神经辐射场技术,从RGB图像重建无遮挡地面视图。
  • 在低光照下仍能还原清晰细节,支持搜救与树木计数任务。
  • 无需昂贵设备,适合野外搜救、步道规划和森林调查。

在搜索救援、步道规划、森林清查等任务中,获取被密集树冠遮挡的地面地形信息具有重要意义。现有方法依赖专用传感器:如重型高成本机载激光雷达,或专用于人体检测的机载光学断层成像(AOS),后者使用热合成孔径摄影。本文提出一种新方法,仅利用常规RGB图像即可重建无树冠遮挡的逼真地面视图。该方法基于先进的神经辐射场(NeRF)3D重建技术,并结合特定的图像采集策略,确保充分照明以揭示林下场景。为应对林下光线不足问题,引入低光损失机制。同时提出两种互补的遮挡树冠去除方法,通过控制每条射线的积分过程实现。为验证有效性,我们展示了两个下游任务:在搜救任务中,仅用RGB图像即实现人体检测,性能媲美热成像AOS;在森林清查中,可有效支持树木计数。结果表明,本方法为搜救、步道规划与森林清查提供了一种低成本、高分辨率的替代方案。

原文摘要 · Abstract (English)

Mapping the terrain and understory hidden beneath dense forest canopies is of great interest for numerous applications such as search and rescue, trail mapping, forest inventory tasks, and more. Existing solutions rely on specialized sensors: either heavy, costly airborne LiDAR, or Airborne Optical Sectioning (AOS), which uses thermal synthetic aperture photography and is tailored for person detection. We introduce a novel approach for the reconstruction of canopy-free, photorealistic ground views using only conventional RGB images. Our solution is based on the celebrated Neural Radiance Fields (NeRF), a recent 3D reconstruction method. Additionally, we include specific image capture considerations, which dictate the needed illumination to successfully expose the scene beneath the canopy. To better cope with the poorly lit understory, we employ a low light loss. Finally, we propose two complementary approaches to remove occluding canopy elements by controlling per-ray integration procedure. To validate the value of our approach, we present two possible downstream tasks. For the task of search and rescue (SAR), we demonstrate that our method enables person detection which achieves promising results compared to thermal AOS (using only RGB images). Additionally, we show the potential of our approach for forest inventory tasks like tree counting. These results position our approach as a cost-effective, high-resolution alternative to specialized sensors for SAR, trail mapping, and forest-inventory tasks.

3D重建森林测绘视觉感知

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。