用Mamba结构提升小交通标志检测精度与速度
MDDFNet: Mamba-based Dynamic Dual Fusion Network for Traffic Sign Detection
- 引入动态双路融合模块增强特征多样性
- 在TT100K数据集上达到领先检测精度,保持实时推理
- 适合需要高精度小目标检测的自动驾驶场景
小物体检测,尤其是交通标志检测,是目标检测与自动驾驶中的关键任务。尽管已有显著进展,仍存在两大挑战:特征提取过于单一,且检测过程难以有效处理不同尺度的目标。为解决这些问题,本文提出基于Mamba的动态双融合网络(MDDFNet),融合动态双路融合模块与Mamba骨干网络,同时应对上述问题。动态双路融合模块通过多分支整合空间与语义信息,提升特征多样性;Mamba骨干网络则利用全局特征融合与局部特征交互,自适应地生成独特分类特征。在TT100K(清华大学-腾讯100万)数据集上的大量实验表明,MDDFNet优于现有先进检测器,在保持单阶段模型实时性的同时实现更优性能,验证了其在小交通标志检测中的有效性。
原文摘要 · Abstract (English)
The Detection of small objects, especially traffic signs, is a critical sub-task in object detection and autonomous driving. Despite signficant progress in previous research, two main challenges remain. First, the issue of feature extraction being too singular. Second, the detection process struggles to efectively handle objects of varying sizes or scales. These problems are also prevalent in general object detection tasks. To address these challenges, we propose a novel object detection network, Mamba-based Dynamic Dual Fusion Network (MDDFNet), for traffic sign detection. The network integrates a dynamic dual fusion module and a Mamba-based backbone to simultaneously tackle the aforementioned issues. Specifically, the dynamic dual fusion module utilizes multiple branches to consolidate various spatial and semantic information, thus enhancing feature diversity. The Mamba-based backbone leverages global feature fusion and local feature interaction, combining features in an adaptive manner to generate unique classification characteristics. Extensive experiments conducted on the TT100K (Tsinghua-Tencent 100K) datasets demonstrate that MDDFNet outperforms other state-of-the-art detectors, maintaining real-time processing capabilities of single-stage models while achieving superior performance. This confirms the efectiveness of MDDFNet in detecting small traffic signs.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。