用可变形膨胀卷积增强Mamba,提升复杂交通场景中小目标检测精度
Beyond Mamba: Enhancing State-space Models with Deformable Dilated Convolutions for Multi-scale Traffic Object Detection
- 混合主干网络融合可变形膨胀卷积与Mamba模块,分层提取特征
- 在COCO-Traffic和RealTraffic上实现更优小目标检测性能,精度显著提升
- 适合需要高精度多尺度交通目标检测的智能驾驶系统研发
真实交通场景中,尺度各异的目标常分布于杂乱背景中,给精确检测带来挑战。尽管现有基于Mamba的方法能高效建模长程依赖,仍难以捕捉具有丰富局部细节的小目标,阻碍了局部结构与全局语义的联合建模。同时,状态空间模型因采用扁平序列建模且缺乏空间归纳偏置,导致层次化特征表示能力弱、跨尺度交互不足,影响复杂场景下的表现。为此,本文提出一种结合可变形膨胀卷积的Mamba网络(MDDCNet)。该网络采用依次堆叠的多尺度可变形膨胀卷积(MSDDC)块与Mamba块构成混合主干,实现从局部细节到全局语义的层次化特征表达。进一步设计通道增强前馈网络(CE-FFN)以克服传统前馈网络通道交互能力有限的问题,并构建基于Mamba的注意力聚合特征金字塔网络(A²FPN),实现更强的多尺度特征融合与交互。在公开基准数据集与真实世界数据集上的大量实验表明,本方法优于多种先进检测器。代码已开源:https://github.com/Bettermea/MDDCNet。
原文摘要 · Abstract (English)
In a real-world traffic scenario, varying-scale objects are usually distributed in a cluttered background, which poses great challenges to accurate detection. Although current Mamba-based methods can efficiently model long-range dependencies, they still struggle to capture small objects with abundant local details, which hinders joint modeling of local structures and global semantics. Moreover, state-space models exhibit limited hierarchical feature representation and weak cross-scale interaction due to flat sequential modeling and insufficient spatial inductive biases, leading to sub-optimal performance in complex scenes. To address these issues, we propose a Mamba with Deformable Dilated Convolutions Network (MDDCNet) for accurate traffic object detection in this study. In MDDCNet, a well-designed hybrid backbone with successive Multi-Scale Deformable Dilated Convolution (MSDDC) blocks and Mamba blocks enables hierarchical feature representation from local details to global semantics. Meanwhile, a Channel-Enhanced Feed-Forward Network (CE-FFN) is further devised to overcome the limited channel interaction capability of conventional feed-forward networks, whilst a Mamba-based Attention-Aggregating Feature Pyramid Network (A^2FPN) is constructed to achieve enhanced multi-scale feature fusion and interaction. Extensive experimental results on public benchmark and real-world datasets demonstrate the superiority of our method over various advanced detectors. The code is available at https://github.com/Bettermea/MDDCNet.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。