arXiv:2605.20667cs.CV2026-05

针对红外可见光无人机检测中的错位问题,提出可靠性感知的专家路由模型。

LER-YOLO: Reliability-Aware Expert Routing for Misaligned RGB-Infrared UAV Detection

论文配图:LER-YOLO: Reliability-Aware Expert Routing for Misaligned RGB-Infrared UAV Detection
图 1 · 摘自论文原文
  • 通过不确定性感知对齐模块生成空间可靠性图
  • 基于可靠性动态选择专家,提升跨模态融合可信度
  • 在公开数据集上达89.9% AP50,效果优于传统融合方法

由于目标尺寸小、背景杂乱以及异构传感器间存在空间错位,从红外-可见光遥感图像对中检测小型无人机仍具挑战。现有双模态检测器通常直接对齐或融合特征,未评估局部跨传感器对应关系的可靠性,导致误匹配伪影传播至检测头。为此,我们提出LER-YOLO,一种面向错位红外-可见光无人机检测的可靠性感知稀疏专家混合框架。该方法首先引入不确定性感知目标对齐模块,将可见光特征重采样至红外参考坐标系,并估计空间可靠性图。该可靠性先验由可靠性引导的稀疏MoE融合模块使用,自适应从可见光主导、红外主导及交互融合三类专家中选择k个最优专家,实现可信跨模态交互并抑制不可靠融合。在公开MBU基准数据集上,采用YOLOv5s系列协议测试,LER-YOLO在三个独立种子下取得89.7±0.2% AP50,最佳结果为89.9%。大量消融实验、参数匹配对比、合成偏移评估与复杂度分析表明,性能提升主要源于可靠性引导的专家路由机制,而非模型容量增加。

原文摘要 · Abstract (English)

Detecting small unmanned aerial vehicles from RGB-infrared remote-sensing pairs remains challenging due to tiny target scale, cluttered backgrounds, and spatial misalignment between heterogeneous sensors. Existing bimodal detectors often align or fuse features without assessing the reliability of local cross-sensor correspondence, allowing mismatch artifacts to propagate into the detection head. To address this issue, we propose LER-YOLO, a reliability-aware sparse mixture-of-experts framework for misaligned RGB-infrared UAV detection. LER-YOLO first introduces an Uncertainty-Aware Target Alignment module that resamples visible features toward the infrared reference and estimates a spatial reliability map. This reliability prior is then used by a Reliability-Guided Sparse MoE Fusion module to adaptively select k experts from RGB-dominant, infrared-dominant, and interactive fusion experts, enabling trustworthy cross-modal interaction while suppressing unreliable fusion. Experiments on the public MBU benchmark under a YOLOv5s-family protocol show that LER-YOLO achieves 89.7+/-0.2% AP50 over three independent seeds, with a best result of 89.9%. Extensive ablations, parameter-matched comparisons, synthetic-shift evaluations, and complexity analysis demonstrate that the gains mainly come from reliability-guided expert routing rather than increased model capacity.

多模态检测专家混合无人机识别可靠性感知

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。