YOLO11-4K高效检测4K全景图中小目标,速度提升75%。
YOLO11-4K: An Efficient Architecture for Real-Time Small Object Detection in 4K Panoramic Images
- 用P2多尺度头和GhostConv骨干网提升小目标敏感度与效率
- 4K全景图下0.95 [email protected],单帧推理仅28.3毫秒
- 适合自动驾驶、安防、增强现实等高分辨率场景
360度全景图像的处理因固有的空间畸变、宽视场和超高清输入而面临挑战。传统检测器如YOLO针对标准尺寸(如640x640像素)优化,难以应对4K及以上分辨率的全景图像计算压力。为此,我们提出YOLO11-4K,一种专为4K全景图像设计的高效实时检测框架。该架构引入新型多尺度检测头(含P2层),提升对细小目标的敏感性;采用基于GhostConv的骨干网络,在不损失表征能力的前提下降低计算复杂度。为支持评估,我们手动标注了CVIP360数据集,生成6,876个帧级边界框,构建公开可用的4K全景检测基准。YOLO11-4K在0.50 IoU下实现0.95 mAP,单帧推理时间28.3毫秒,相比YOLO11(112.3毫秒)延迟降低75%,同时精度提升(0.95对比0.908)。该效率与精度平衡使其适用于大范围360度环境中的鲁棒目标检测,广泛适用于自动驾驶、监控和增强现实等高分辨率任务。
原文摘要 · Abstract (English)
The processing of omnidirectional 360-degree images poses significant challenges for object detection due to inherent spatial distortions, wide fields of view, and ultra-high-resolution inputs. Conventional detectors such as YOLO are optimised for standard image sizes (for example, 640x640 pixels) and often struggle with the computational demands of 4K or higher-resolution imagery typical of 360-degree vision. To address these limitations, we introduce YOLO11-4K, an efficient real-time detection framework tailored for 4K panoramic images. The architecture incorporates a novel multi-scale detection head with a P2 layer to improve sensitivity to small objects often missed at coarser scales, and a GhostConv-based backbone to reduce computational complexity without sacrificing representational power. To enable evaluation, we manually annotated the CVIP360 dataset, generating 6,876 frame-level bounding boxes and producing a publicly available, detection-ready benchmark for 4K panoramic scenes. YOLO11-4K achieves 0.95 mAP at 0.50 IoU with 28.3 milliseconds inference per frame, representing a 75 percent latency reduction compared to YOLO11 (112.3 milliseconds), while also improving accuracy (mAP at 0.50 of 0.95 versus 0.908). This balance of efficiency and precision enables robust object detection in expansive 360-degree environments, making the framework suitable for real-world high-resolution panoramic applications. While this work focuses on 4K omnidirectional images, the approach is broadly applicable to high-resolution detection tasks in autonomous navigation, surveillance, and augmented reality.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。