融合点云投影与YOLOv5,提升智能车前多目标检测追踪精度
Intelligent driving vehicle front multi-target tracking and detection based on YOLOv5 and point cloud 3D projection
- 用Retinex增强图像,再通过YOLOv5识别前方目标
- 结合点云3D投影,实现连续帧间目标轨迹关联
- 在真实场景中实现超过30的MOTA,适合自动驾驶感知
在多目标追踪与检测任务中,需持续追踪车辆、行人等目标。系统须不断获取并处理包含目标的图像帧,以实现实时更新目标位置与状态。如何准确关联前后帧中的目标以形成稳定轨迹是一大挑战。为此,提出一种基于YOLOv5与点云3D投影的智能驾驶车辆前方多目标追踪检测方法。采用Retinex算法增强车辆前方环境图像,消除光照干扰,并构建基于YOLOv5网络结构的智能检测模型。将增强后的图像输入模型,通过特征提取与目标定位识别前方多个目标。结合点云3D投影技术,推断相邻帧图像在投影坐标系中的位置变化关联性。通过将多帧连续图像的目标识别结果依次投影至3D激光点云环境,实现对车辆前方所有目标运动轨迹的有效追踪。实验结果表明,该方法在智能驾驶车辆前方多目标追踪与检测中取得超过30的MOTA值,展现出优异的追踪与检测性能。
原文摘要 · Abstract (English)
In multi-target tracking and detection tasks, it is necessary to continuously track multiple targets, such as vehicles, pedestrians, etc. To achieve this goal, the system must be able to continuously acquire and process image frames containing these targets. These consecutive frame images enable the algorithm to update the position and state of the target in real-time in each frame of the image. How to accurately associate the detected target with the target in the previous or next frame to form a stable trajectory is a complex problem. Therefore, a multi object tracking and detection method for intelligent driving vehicles based on YOLOv5 and point cloud 3D projection is proposed. Using Retinex algorithm to enhance the image of the environment in front of the vehicle, remove light interference in the image, and build an intelligent detection model based on YOLOv5 network structure. The enhanced image is input into the model, and multiple targets in front of the vehicle are identified through feature extraction and target localization. By combining point cloud 3D projection technology, the correlation between the position changes of adjacent frame images in the projection coordinate system can be inferred. By sequentially projecting the multi-target recognition results of multiple consecutive frame images into the 3D laser point cloud environment, effective tracking of the motion trajectories of all targets in front of the vehicle can be achieved. The experimental results show that the application of this method for intelligent driving vehicle front multi-target tracking and detection yields a MOTA (Tracking Accuracy) value greater than 30, demonstrating its superior tracking and detection performance.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。