动态融合网络提升复杂场景下目标检测精度
DyCAF-Net: Dynamic Class-Aware Fusion Network
- 根据输入和类别动态调整特征融合,避免固定规则局限
- 在13个数据集上显著提升mAP@50-95,尤其在遮挡和长尾数据上表现突出
- 适合医疗影像、监控与自动驾驶等真实复杂场景应用
当前目标检测依赖多尺度融合与注意力机制的模块化架构,但静态融合策略和类无关注意力在存在遮挡、杂乱和类别不平衡的动态场景中表现受限。本文提出动态类感知融合网络(DyCAF-Net),通过三项创新解决该问题:(1) 输入条件驱动的平衡型颈部结构,通过隐式不动点建模迭代优化多尺度特征;(2) 双重动态注意力机制,利用输入和类别相关线索自适应校准通道与空间响应;(3) 类别感知特征适配,增强罕见类别的判别区域。在YOLOv8等架构上的全面消融实验及与九种先进基线的对比表明,DyCAF-Net在13个多样化基准上均显著提升精度、mAP@50和mAP@50-95。模型参数量约11.1M,推理速度具有竞争力,对尺度变化、语义重叠和类别不平衡具有强适应性,适用于医学影像、监控和自动驾驶等现实检测任务。
原文摘要 · Abstract (English)
Recent advancements in object detection rely on modular architectures with multi-scale fusion and attention mechanisms. However, static fusion heuristics and class-agnostic attention limit performance in dynamic scenes with occlusions, clutter, and class imbalance. We introduce Dynamic Class-Aware Fusion Network (DyCAF-Net) that addresses these challenges through three innovations: (1) an input-conditioned equilibrium-based neck that iteratively refines multi-scale features via implicit fixed-point modeling, (2) a dual dynamic attention mechanism that adaptively recalibrates channel and spatial responses using input- and class-dependent cues, and (3) class-aware feature adaptation that modulates features to prioritize discriminative regions for rare classes. Through comprehensive ablation studies with YOLOv8 and related architectures, alongside benchmarking against nine state-of-the-art baselines, DyCAF-Net achieves significant improvements in precision, mAP@50, and mAP@50-95 across 13 diverse benchmarks, including occlusion-heavy and long-tailed datasets. The framework maintains computational efficiency ($\sim$11.1M parameters) and competitive inference speeds, while its adaptability to scale variance, semantic overlaps, and class imbalance positions it as a robust solution for real-world detection tasks in medical imaging, surveillance, and autonomous systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。