arXiv:2512.23273cs.CV2025-12被引 18

YOLO-Master用动态专家网络让检测模型聪明地分配算力,快且准。

YOLO-Master: MOE-Accelerated with Specialized Transformers for Enhanced Real-time Detection

  • 引入轻量动态路由的稀疏专家模块,按图像复杂度自动分配计算资源。
  • 在COCO上达42.4% AP、1.62ms延迟,比YOLOv13-N快17.8%且高0.8% mAP。
  • 特别适合复杂密集场景,同时保持实时推理速度,适合部署于边缘设备。

现有实时目标检测(RTOD)方法多采用类似YOLO的架构,兼顾精度与速度。但这些模型依赖静态密集计算,对所有输入统一处理,导致算力分配失衡——简单场景过度消耗资源,复杂场景却供给不足,造成冗余计算和性能瓶颈。为此,我们提出YOLO-Master,一种新型类YOLO框架,通过实例相关的自适应计算解决此问题。核心是高效稀疏专家混合(ES-MoE)模块,根据输入场景复杂度动态分配计算资源。其轻量级动态路由网络在训练中通过多样性增强目标引导专家专业化,促进专家间互补;推理时仅激活最相关专家,显著提升性能并控制开销。在五个大规模基准上的实验表明,该模型表现优异:在MS COCO上达到42.4% AP、1.62ms延迟,相较YOLOv13-N实现+0.8% mAP提升与17.8%更快推理速度。尤其在密集复杂场景中优势明显,而普通输入仍保持高效,满足实时性要求。代码将公开。

原文摘要 · Abstract (English)

Existing Real-Time Object Detection (RTOD) methods commonly adopt YOLO-like architectures for their favorable trade-off between accuracy and speed. However, these models rely on static dense computation that applies uniform processing to all inputs, misallocating representational capacity and computational resources such as over-allocating on trivial scenes while under-serving complex ones. This mismatch results in both computational redundancy and suboptimal detection performance. To overcome this limitation, we propose YOLO-Master, a novel YOLO-like framework that introduces instance-conditional adaptive computation for RTOD. This is achieved through a Efficient Sparse Mixture-of-Experts (ES-MoE) block that dynamically allocates computational resources to each input according to its scene complexity. At its core, a lightweight dynamic routing network guides expert specialization during training through a diversity enhancing objective, encouraging complementary expertise among experts. Additionally, the routing network adaptively learns to activate only the most relevant experts, thereby improving detection performance while minimizing computational overhead during inference. Comprehensive experiments on five large-scale benchmarks demonstrate the superiority of YOLO-Master. On MS COCO, our model achieves 42.4% AP with 1.62ms latency, outperforming YOLOv13-N by +0.8% mAP and 17.8% faster inference. Notably, the gains are most pronounced on challenging dense scenes, while the model preserves efficiency on typical inputs and maintains real-time inference speed. Code will be available.

目标检测自适应计算MoE实时推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。