通过融合局部与全局上下文,提升自动驾驶中共现物体的检测精度。
Context-Aware Feature-Fusion for Co-occurring Object Detection in Autonomous Driving

- 设计双注意力模块,分别捕捉物体间局部交互和全局共现关系。
- 在Cityscapes和BDD100K上实现0.973和0.969的类别一致性指标,小物体检测提升14.1%。
- 适合需要精准识别稀有或小尺寸物体的自动驾驶场景。
自动驾驶中的目标检测需精确定位并理解共现物体间的上下文关系。在复杂异构环境中,稀有类别、小尺度物体及高频出现物体难以被标准检测框架处理。本文提出一种名为面向上下文的特征融合(CCFF)的新框架,包含两个基于注意力的模块:局部上下文融合模块(LCFM)利用区域对区域自注意力机制,解决空间交互问题,尤其关注小物体和部分遮挡物体;全局上下文注意力模块(GCAM)通过池化前K个候选框特征生成全局上下文注意力令牌,避免像素级全局池化的计算开销。该方法融合局部与以物体为中心的全局特征,获得上下文感知嵌入,显著提升分类性能与共现物体检测能力。在Cityscapes和BDD100K数据集上的评估表明,关系一致性指标(CCS)分别达到0.973和0.969。此外,小物体检测平均精度(AP_S)提升14.1%,成功恢复了“Train”等通常被忽略的稀有类别。效率报告显示,该框架可实时处理图像,仅带来0.2 FPS的额外开销。代码已开源于https://github.com/BinayKSingh/CCFF。
原文摘要 · Abstract (English)
Object detection in autonomous driving requires precise localization and an inherent understanding of the relational context between co-occurring objects. In extremely complex heterogeneous environments rare classes, small-scale objects, and frequently appearing objects are difficult for standard object detection frameworks to handle. In this paper, we propose a novel framework called Context-Centric Feature Fusion (CCFF), which utilizes two attention-based modules, Local Context Fusion Module (LCFM) uses the RoI-to-RoI self-attention mechanism to resolve spatial interactions, mainly considering small and partially obscured objects, while Global Context Attention Module (GCAM) converts the co-occurrence of objects priors by pooling top-K RoI features into a global context attention token, avoiding the computational overhead of pixel-level global pooling. This fusion of local and object-centric global features yields contextualized embeddings that enhance classification results and co-occurring objects detection. Our method is evaluated on two datasets, Cityscapes and BDD100K which demonstrate significant improvement on relational consistency, achieving a Category-level Consistency Strategy (CCS) of 0.973 and 0.969, respectively. Furthermore, our approach produces substantial gains in small object detection (AP_S: 14.1%) and successfully recovers rare classes such as "Train" that are typically lost in large distributions. Our efficiency report shows that the framework processes images in real time with a 0.2 FPS overhead. The code is available at https://github.com/BinayKSingh/CCFF.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。