综述YOLO在多光谱目标检测中的进展与挑战,聚焦应用与未来方向。
Surveying You Only Look Once (YOLO) Multispectral Object Detection Advancements, Applications And Challenges
- 系统梳理400篇论文,重点分析YOLO在多光谱场景的适配方法。
- 39%研究融合RGB与长波红外,33%采用YOLOv5模型,中国占58%研究。
- 建议发展可适应多谱段输入的通用架构,拓展传感器融合新范式。
多光谱成像与深度学习已成为自动驾驶、农业、基础设施监测和环境评估等领域的关键技术。两者结合显著提升了非可见光谱中的目标检测、分类与分割性能。本文共调研400篇文献,深入分析其中200篇,全面回顾多光谱成像技术、深度学习模型及应用进展,重点关注You Only Look Once(YOLO)方法的演化与适配。地面采集是最主流方式,占所评论文的63%,而无人机(UAS)在2020年后应用翻倍。最常见传感器融合为RGB与长波红外(LWIR),占39%。YOLOv5是应用最广的变体,占所有改造模型的33%。58%的多光谱-YOLO研究来自中国,其平均期刊影响因子为4.45,与非中国机构(4.36)相当。未来研究需聚焦:(i) 开发能适应多样光谱输入且无需大量结构修改的自适应YOLO架构;(ii) 探索大规模合成多光谱数据集生成方法;(iii) 提升多光谱YOLO的迁移学习能力以缓解数据稀缺问题;(iv) 拓展与除RGB和LWIR外其他传感器的融合研究。
原文摘要 · Abstract (English)
Multispectral imaging and deep learning have emerged as powerful tools supporting diverse use cases from autonomous vehicles, to agriculture, infrastructure monitoring and environmental assessment. The combination of these technologies has led to significant advancements in object detection, classification, and segmentation tasks in the non-visible light spectrum. This paper considers 400 total papers, reviewing 200 in detail to provide an authoritative meta-review of multispectral imaging technologies, deep learning models, and their applications, considering the evolution and adaptation of You Only Look Once (YOLO) methods. Ground-based collection is the most prevalent approach, totaling 63% of the papers reviewed, although uncrewed aerial systems (UAS) for YOLO-multispectral applications have doubled since 2020. The most prevalent sensor fusion is Red-Green-Blue (RGB) with Long-Wave Infrared (LWIR), comprising 39% of the literature. YOLOv5 remains the most used variant for adaption to multispectral applications, consisting of 33% of all modified YOLO models reviewed. 58% of multispectral-YOLO research is being conducted in China, with broadly similar research quality to other countries (with a mean journal impact factor of 4.45 versus 4.36 for papers not originating from Chinese institutions). Future research needs to focus on (i) developing adaptive YOLO architectures capable of handling diverse spectral inputs that do not require extensive architectural modifications, (ii) exploring methods to generate large synthetic multispectral datasets, (iii) advancing multispectral YOLO transfer learning techniques to address dataset scarcity, and (iv) innovating fusion research with other sensor types beyond RGB and LWIR.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。