arXiv:2505.00534cs.CV2025-05被引 16

基于深度学习的跨摄像头车辆追踪系统,提升城市交通监控精度。

A Robust Deep Networks based Multi-Object MultiCamera Tracking System for City Scale Traffic

  • 用Mask R-CNN检测目标,结合NMS过滤重叠框,提升检测准确率。
  • 在AI City挑战赛数据集上实现IDF1 0.8289,精度达90.26%。
  • 适合大规模城市交通场景,对遮挡、光照变化有较强鲁棒性。

视觉传感器在智能交通系统中日益重要,但城市尺度下多摄像头、非重叠视野的多目标追踪面临车辆属性多样、遮挡、光照变化、阴影和分辨率差异等挑战。为此,提出一种高效低成本的深度学习框架用于多目标多摄像头追踪(MO-MCT)。该框架采用Mask R-CNN进行目标检测,并通过非极大值抑制(NMS)筛选重叠检测结果;利用迁移学习实现车辆重识别,关联并生成跨摄像头的轨迹片段;引入合适的损失函数与距离度量以应对遮挡、光照和阴影问题。最终通过ResNet-152与Deep SORT结合进行特征提取与跟踪。在第5届AI City Challenge数据集(Track 3)上评估,共46路摄像头视频流,其中40路用于训练验证,6路用于测试。模型取得IDF1 0.8289,精度0.9026,召回率0.8527,证明其在复杂城市交通环境下的有效性。

原文摘要 · Abstract (English)

Vision sensors are becoming more important in Intelligent Transportation Systems (ITS) for traffic monitoring, management, and optimization as the number of network cameras continues to rise. However, manual object tracking and matching across multiple non-overlapping cameras pose significant challenges in city-scale urban traffic scenarios. These challenges include handling diverse vehicle attributes, occlusions, illumination variations, shadows, and varying video resolutions. To address these issues, we propose an efficient and cost-effective deep learning-based framework for Multi-Object Multi-Camera Tracking (MO-MCT). The proposed framework utilizes Mask R-CNN for object detection and employs Non-Maximum Suppression (NMS) to select target objects from overlapping detections. Transfer learning is employed for re-identification, enabling the association and generation of vehicle tracklets across multiple cameras. Moreover, we leverage appropriate loss functions and distance measures to handle occlusion, illumination, and shadow challenges. The final solution identification module performs feature extraction using ResNet-152 coupled with Deep SORT based vehicle tracking. The proposed framework is evaluated on the 5th AI City Challenge dataset (Track 3), comprising 46 camera feeds. Among these 46 camera streams, 40 are used for model training and validation, while the remaining six are utilized for model testing. The proposed framework achieves competitive performance with an IDF1 score of 0.8289, and precision and recall scores of 0.9026 and 0.8527 respectively, demonstrating its effectiveness in robust and accurate vehicle tracking.

多目标追踪城市交通深度学习跨摄像头

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。