用结构光实现单传感器多光谱与深度同步感知,提升无人机林区探测能力。
Event Spectroscopy: Event-based Multispectral and Depth Sensing using Structured Light
- 单传感器融合结构光与波长调制,同步获取深度与多光谱数据
- 深度误差比商用传感器降低60%,光谱精度媲美专业设备
- 适用于无人机林区导航与材料识别,深度信息使分类准确率提升30%以上
无人飞行器(UAV)在森林环境中的应用日益增多,如环境监测与搜救任务,要求其在密集植被中安全航行并精确采集数据。传统传感方法(如被动多光谱和RGB成像)存在延迟高、深度分辨率差、依赖环境光等问题,尤其在树冠下表现不佳。本文提出一种新型事件光谱系统,仅用单一传感器即可实现高分辨率、低延迟的深度重建与集成多光谱成像。通过调制投射结构光的波长,在650 nm至850 nm范围内捕获受控波段的光谱信息。实验表明,该系统深度重建均方根误差(RMSE)相比商用传感器提升高达60%,光谱精度经参考光谱仪和商用多光谱相机验证,达到相当水平。便携式原型机仅支持RGB(3个波段)版本,在马索拉雨林中实测获取真实世界的深度与光谱数据。结果表明,利用光谱与深度联合数据可实现彩色图像重建,并有效区分叶片与枝干;相比仅依赖颜色的方法,材料识别准确率提升超过30%。系统在实验室与真实雨林环境中均表现出色,展现出在复杂自然环境下轻量化、一体化、鲁棒性强的无人机感知与数据采集潜力。
原文摘要 · Abstract (English)
Uncrewed aerial vehicles (UAVs) are increasingly deployed in forest environments for tasks such as environmental monitoring and search and rescue, which require safe navigation through dense foliage and precise data collection. Traditional sensing approaches, including passive multispectral and RGB imaging, suffer from latency, poor depth resolution, and strong dependence on ambient light - especially under forest canopies. In this work, we present a novel event spectroscopy system that simultaneously enables high-resolution, low-latency depth reconstruction with integrated multispectral imaging using a single sensor. Depth is reconstructed using structured light, and by modulating the wavelength of the projected structured light, our system captures spectral information in controlled bands between 650 nm and 850 nm. We demonstrate up to $60\%$ improvement in RMSE over commercial depth sensors and validate the spectral accuracy against a reference spectrometer and commercial multispectral cameras, demonstrating comparable performance. A portable version limited to RGB (3 wavelengths) is used to collect real-world depth and spectral data from a Masoala Rainforest. We demonstrate the use of this prototype for color image reconstruction and material differentiation between leaves and branches using spectral and depth data. Our results show that adding depth (available at no extra effort with our setup) to material differentiation improves the accuracy by over $30\%$ compared to color-only method. Our system, tested in both lab and real-world rainforest environments, shows strong performance in depth estimation, RGB reconstruction, and material differentiation - paving the way for lightweight, integrated, and robust UAV perception and data collection in complex natural environments.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。