arXiv:2506.03654cs.CVcs.AI2025-06被引 3

用混合模型提升目标检测速度与精度,适合边缘设备部署。

MambaNeXt-YOLO: A Hybrid State Space Model for Real-time Object Detection

  • 结合CNN与Mamba构建新模块,兼顾局部特征与长距离依赖。
  • 在PASCAL VOC上达66.6% mAP,推理速度31.9 FPS,无需预训练。
  • 专为边缘设备优化,可部署于Jetson Xavier NX等硬件。

实时目标检测在计算机视觉中至关重要但面临挑战,尤其在计算资源受限时。尽管YOLO系列模型在速度与精度间取得良好平衡,但对更丰富全局上下文建模的需求促使采用基于Transformer的架构。然而,自注意力机制导致变压器计算复杂度高,限制了其在实时及边缘场景的应用。线性状态空间模型(如Mamba)通过线性复杂度实现高效序列建模,成为有前景的替代方案。为此,我们提出MambaNeXt-YOLO,一种新型目标检测框架,通过三项关键贡献实现精度与效率的平衡:(1) MambaNeXt Block:融合CNN与Mamba的混合设计,有效捕捉局部特征与长程依赖;(2) 多分支非对称融合金字塔网络(MAFPN):增强多尺度特征金字塔,提升不同尺寸物体的检测性能;(3) 面向边缘的高效性:在PASCAL VOC数据集上达到66.6% mAP,推理速度31.9 FPS,无需预训练,支持在NVIDIA Jetson Xavier NX和Orin NX等边缘设备上部署。

原文摘要 · Abstract (English)

Real-time object detection is a fundamental but challenging task in computer vision, particularly when computational resources are limited. Although YOLO-series models have set strong benchmarks by balancing speed and accuracy, the increasing need for richer global context modeling has led to the use of Transformer-based architectures. Nevertheless, Transformers have high computational complexity because of their self-attention mechanism, which limits their practicality for real-time and edge deployments. To overcome these challenges, recent developments in linear state space models, such as Mamba, provide a promising alternative by enabling efficient sequence modeling with linear complexity. Building on this insight, we propose MambaNeXt-YOLO, a novel object detection framework that balances accuracy and efficiency through three key contributions: (1) MambaNeXt Block: a hybrid design that integrates CNNs with Mamba to effectively capture both local features and long-range dependencies; (2) Multi-branch Asymmetric Fusion Pyramid Network (MAFPN): an enhanced feature pyramid architecture that improves multi-scale object detection across various object sizes; and (3) Edge-focused Efficiency: our method achieved 66.6% mAP at 31.9 FPS on the PASCAL VOC dataset without any pre-training and supports deployment on edge devices such as the NVIDIA Jetson Xavier NX and Orin NX.

目标检测边缘计算状态空间模型YOLO

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。