arXiv:2503.10034cs.CVcs.RO2025-03被引 11

首个真实场景下在线协同感知框架,验证了中间融合的可行性。

V2X-ReaLO: An Open Online Framework and Dataset for Cooperative Perception in Reality

  • 构建真实车辆与智能基础设施的协同感知系统,支持早/晚/中间融合统一流程。
  • 在动态城市场景中提供25,028帧数据,含6,850个标注关键帧,验证性能。
  • 适合研究真实环境协同感知、车联网感知优化的学者与工程师使用。

基于车用万物通信(V2X)的协同感知有望显著提升自动驾驶车辆的感知能力,突破遮挡限制并扩展视野。然而,现有研究多依赖仿真环境或静态数据集,真实场景下尤其是中间融合方式的可行性与有效性仍不清楚。本文提出 V2X-ReaLO,一个部署于真实车辆与智能基础设施上的开放在线协同感知框架,首次在真实动态环境中实现并验证了在线中间融合的可行性与性能。该框架集成早期、晚期与中间融合方法,形成统一处理流程。同时,我们发布一个专为评估在线协同感知系统而设计的开源基准数据集,扩展自 V2X-Real,包含动态同步的 ROS bag 数据,共25,028个测试帧,其中6,850帧带标注,覆盖复杂城市场景。该系统可实时评估感知精度与通信延迟,为真实应用中的协同感知系统发展树立新标杆。代码与数据集将公开,以推动领域进步。

原文摘要 · Abstract (English)

Cooperative perception enabled by Vehicle-to-Everything (V2X) communication holds significant promise for enhancing the perception capabilities of autonomous vehicles, allowing them to overcome occlusions and extend their field of view. However, existing research predominantly relies on simulated environments or static datasets, leaving the feasibility and effectiveness of V2X cooperative perception especially for intermediate fusion in real-world scenarios largely unexplored. In this work, we introduce V2X-ReaLO, an open online cooperative perception framework deployed on real vehicles and smart infrastructure that integrates early, late, and intermediate fusion methods within a unified pipeline and provides the first practical demonstration of online intermediate fusion's feasibility and performance under genuine real-world conditions. Additionally, we present an open benchmark dataset specifically designed to assess the performance of online cooperative perception systems. This new dataset extends V2X-Real dataset to dynamic, synchronized ROS bags and provides 25,028 test frames with 6,850 annotated key frames in challenging urban scenarios. By enabling real-time assessments of perception accuracy and communication lantency under dynamic conditions, V2X-ReaLO sets a new benchmark for advancing and optimizing cooperative perception systems in real-world applications. The codes and datasets will be released to further advance the field.

协同感知V2X真实场景中间融合

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。