CorrDiff通过动态时间线索补偿延迟,实现跨设备实时目标检测
CorrDiff: Adaptive Delay-aware Detector with Temporal Cue Inputs for Real-time Object Detection
- 引入自适应延迟感知机制,利用运行时估计的时间线索预测未来多帧目标位置
- 在mAP和sAP指标上均超越现有方法,实现在特斯拉V100到RTX 2080Ti全设备上高精度检测
- 适合对延迟敏感的自动驾驶等实时系统,尤其适用于算力受限场景
实时目标检测在自动驾驶等实际应用中至关重要。本文提出一种名为CorrDiff的新方法,解决实时检测系统中的延迟问题。其核心是自适应延迟感知检测器,可利用运行时估计的时间线索,预测多个未来帧中物体的位置,并仅生成与真实时间匹配的预测结果,有效补偿通信与计算延迟。该模型通过运动估计与特征增强,在单帧检测(当前帧或下一帧)的mAP指标,以及多帧未来预测的sAP指标上均优于现有最优方法。在从高性能特斯拉V100到中等性能的RTX 2080Ti的各种设备上均表现稳健,所有平台均达到最高感知精度。不同于多数先进方法在低算力设备上无法单帧完成计算,CorrDiff在各类设备上均满足严格实时处理要求。实验结果表明该系统具备高度适应性,显著提升自动驾驶等系统的安全性和可靠性。代码已开源,地址为https://anonymous.4open.science/r/CorrDiff。
原文摘要 · Abstract (English)
Real-time object detection takes an essential part in the decision-making process of numerous real-world applications, including collision avoidance and path planning in autonomous driving systems. This paper presents a novel real-time streaming perception method named CorrDiff, designed to tackle the challenge of delays in real-time detection systems. The main contribution of CorrDiff lies in its adaptive delay-aware detector, which is able to utilize runtime-estimated temporal cues to predict objects' locations for multiple future frames, and selectively produce predictions that matches real-world time, effectively compensating for any communication and computational delays. The proposed model outperforms current state-of-the-art methods by leveraging motion estimation and feature enhancement, both for 1) single-frame detection for the current frame or the next frame, in terms of the metric mAP, and 2) the prediction for (multiple) future frame(s), in terms of the metric sAP (The sAP metric is to evaluate object detection algorithms in streaming scenarios, factoring in both latency and accuracy). It demonstrates robust performance across a range of devices, from powerful Tesla V100 to modest RTX 2080Ti, achieving the highest level of perceptual accuracy on all platforms. Unlike most state-of-the-art methods that struggle to complete computation within a single frame on less powerful devices, CorrDiff meets the stringent real-time processing requirements on all kinds of devices. The experimental results emphasize the system's adaptability and its potential to significantly improve the safety and reliability for many real-world systems, such as autonomous driving. Our code is completely open-sourced and is available at https://anonymous.4open.science/r/CorrDiff.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。