多摄像头融合实现无遮挡道路占用检测,提升交通监控精度
MC-BEVRO: Multi-Camera Bird Eye View Road Occupancy Detection for Traffic Monitoring
- 多路摄像头输入通过鸟瞰图融合,解决视角受限与遮挡问题
- 仿真数据集+真实场景验证,模型在零样本下仍具泛化能力
- 适合智能交通系统、城市道路监控等实际部署场景
单摄像头3D交通感知因遮挡和视场有限面临挑战,多摄像头图像特征级融合也因视角差异困难。为应对这些问题,本文提出一种基于多路路边摄像头的鸟瞰图道路占用检测框架。为支持开发与评估,使用CARLA模拟器生成包含多样场景和不同相机配置的合成数据集。在框架中实现了一种后融合及三种前融合方法,并通过引入背景信息进一步提升性能。通过大量实验分析了多摄像头输入与不同鸟瞰图占用图尺寸对模型表现的影响。此外,构建了真实数据采集流程以评估模型在现实环境中的泛化能力。采用零样本与少样本微调测试模型的模拟到现实迁移能力,证明其具备实际应用潜力。本研究旨在推动交通监控感知系统发展,助力交通管理优化、运营效率提升与道路安全改善。
原文摘要 · Abstract (English)
Single camera 3D perception for traffic monitoring faces significant challenges due to occlusion and limited field of view. Moreover, fusing information from multiple cameras at the image feature level is difficult because of different view angles. Further, the necessity for practical implementation and compatibility with existing traffic infrastructure compounds these challenges. To address these issues, this paper introduces a novel Bird's-Eye-View road occupancy detection framework that leverages multiple roadside cameras to overcome the aforementioned limitations. To facilitate the framework's development and evaluation, a synthetic dataset featuring diverse scenes and varying camera configurations is generated using the CARLA simulator. A late fusion and three early fusion methods were implemented within the proposed framework, with performance further enhanced by integrating backgrounds. Extensive evaluations were conducted to analyze the impact of multi-camera inputs and varying BEV occupancy map sizes on model performance. Additionally, a real-world data collection pipeline was developed to assess the model's ability to generalize to real-world environments. The sim-to-real capabilities of the model were evaluated using zero-shot and few-shot fine-tuning, demonstrating its potential for practical application. This research aims to advance perception systems in traffic monitoring, contributing to improved traffic management, operational efficiency, and road safety.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。