双流检测系统实时识别无人机及载荷,兼顾精度与速度。
SpectraSentinel: LightWeight Dual-Stream Real-Time Drone Detection, Tracking and Payload Identification
- 分路处理可见光与红外数据,各自优化模型适应不同环境。
- 轻量YOLOv11n在低光、模糊等条件下仍保持高精度检测。
- 适合安防监控场景,尤其对小型无人机追踪有显著优势。
民用空域中无人机泛滥带来紧迫安全威胁,亟需高效实时监视系统。针对2025年VIP Cup挑战任务——无人机检测、跟踪与载荷识别,我们提出一种双流监测框架。该方法在并行的红外(热成像)与可见光(RGB)数据流上分别部署独立的You Only Look Once v11-nano(YOLOv11n)目标检测器,刻意避免早期融合。这种分离设计使各模型可针对输入模态的独特特性进行专项优化,有效应对小尺寸空中目标在复杂环境下的检测挑战。我们为不同领域定制了数据预处理与增强策略,如限制红外图像的色彩抖动,并微调训练超参数以提升在强噪声、低光照及运动模糊条件下的性能。最终的轻量级YOLOv11n模型在区分无人机与鸟类以及分类载荷类型方面表现优异,同时维持实时运行能力。本文详述了双模态设计的动机、专用训练流程及架构优化,共同实现跨RGB与红外通道的高效精准无人机监控。
原文摘要 · Abstract (English)
The proliferation of drones in civilian airspace has raised urgent security concerns, necessitating robust real-time surveillance systems. In response to the 2025 VIP Cup challenge tasks - drone detection, tracking, and payload identification - we propose a dual-stream drone monitoring framework. Our approach deploys independent You Only Look Once v11-nano (YOLOv11n) object detectors on parallel infrared (thermal) and visible (RGB) data streams, deliberately avoiding early fusion. This separation allows each model to be specifically optimized for the distinct characteristics of its input modality, addressing the unique challenges posed by small aerial objects in diverse environmental conditions. We customize data preprocessing and augmentation strategies per domain - such as limiting color jitter for IR imagery - and fine-tune training hyperparameters to enhance detection performance under conditions of heavy noise, low light, and motion blur. The resulting lightweight YOLOv11n models demonstrate high accuracy in distinguishing drones from birds and in classifying payload types, all while maintaining real-time performance. This report details the rationale for a dual-modality design, the specialized training pipelines, and the architectural optimizations that collectively enable efficient and accurate drone surveillance across RGB and IR channels.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。