arXiv:2512.22263cs.CVcs.LG2025-12被引 1

融合可见光与红外图像,自适应提升机器人在不同光照下的追踪能力。

Evaluating an Adaptive Multispectral Turret System for Autonomous Tracking Across Variable Illumination Conditions

论文配图:Evaluating an Adaptive Multispectral Turret System for Autonomous Tracking Across Variable Illumination Conditions
图 1 · 摘自论文原文
  • 根据光照条件动态调整可见光与红外图像的融合比例,选择最优检测模型。
  • 全光照下融合比80/20时检测置信度达92.8%,优于YOLOv5n和YOLOv11n基线。
  • 适用于灾难搜救等复杂光照环境下的自主机器人视觉系统。

自主机器人平台在应急服务领域作用日益重要,支持灾后搜救与侦察任务。传统RGB检测在低光环境下表现不佳,而热成像系统缺乏颜色与纹理信息。为此,本文提出一种自适应框架,通过多比例融合RGB与长波红外(LWIR)视频流,并根据光照条件动态选择最优检测模型。我们在超过22,000张标注图像上训练了33个YOLO模型,覆盖无光(<10 lux)、微光(10-1000 lux)和全光(>1000 lux)三种光照水平。融合采用11种比例(从100/0到0/100,间隔10%),对齐后进行帧级混合。评估显示,全光照最佳模型(80/20)和微光模型(90/10)的平均置信度分别达到92.8%和92.0%,显著优于YOLOv5 nano(YOLOv5n)与YOLOv11 nano(YOLOv11n)基线。无光条件下,最优融合比40/60达到71.0%,虽未达统计显著,但仍高于基线。自适应融合在所有光照条件下均提升了检测置信度与可靠性,显著增强自主机器人视觉性能。

原文摘要 · Abstract (English)

Autonomous robotic platforms are playing a growing role across the emergency services sector, supporting missions such as search and rescue operations in disaster zones and reconnaissance. However, traditional red-green-blue (RGB) detection pipelines struggle in low-light environments, and thermal-based systems lack color and texture information. To overcome these limitations, we present an adaptive framework that fuses RGB and long-wave infrared (LWIR) video streams at multiple fusion ratios and dynamically selects the optimal detection model for each illumination condition. We trained 33 You Only Look Once (YOLO) models on over 22,000 annotated images spanning three light levels: no-light (<10 lux), dim-light (10-1000 lux), and full-light (>1000 lux). To integrate both modalities, fusion was performed by blending aligned RGB and LWIR frames at eleven ratios, from full RGB (100/0) to full LWIR (0/100) in 10% increments. Evaluation showed that the best full-light model (80/20 RGB-LWIR) and dim-light model (90/10 fusion) achieved 92.8% and 92.0% mean confidence; both significantly outperformed the YOLOv5 nano (YOLOv5n) and YOLOv11 nano (YOLOv11n) baselines. Under no-light conditions, the top 40/60 fusion reached 71.0%, exceeding baselines though not statistically significant. Adaptive RGB-LWIR fusion improved detection confidence and reliability across all illumination conditions, enhancing autonomous robotic vision performance.

多模态融合自主追踪光照鲁棒

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。