arXiv:2411.13340cs.CV2024-11被引 7

首个面向自动驾驶协同感知的多智能体调度数据集,支持通信约束下的高效协作研究。

WHALES: A Multi-Agent Scheduling Dataset for Enhanced Cooperation in Autonomous Driving

  • 构建包含8.4个协同智能体/场景的大规模真实交通场景数据集
  • 涵盖201万+3D目标标注,支持通信瓶颈下的调度策略评估
  • 提出基于历史视角覆盖的调度算法,提升感知性能,适合车联网研究者

协同感知研究受限于缺乏能反映真实车联网(V2X)交互复杂性的数据集,尤其在动态通信约束下。为此,我们提出WHALES(无线增强的大量参与智能体自主车辆),首个专为通信感知协同调度与可扩展协同感知设计的大规模V2X数据集。WHALES引入新基准,支持前沿研究,每场景平均含8.4个协同智能体,共201万+3D物体标注,覆盖多样交通场景。数据集集成详细通信元数据,模拟真实通信瓶颈,实现对调度策略的严格评估。为进一步推动领域发展,我们提出覆盖感知历史调度器(CAHS),基于历史视角覆盖选择智能体,相比现有最先进方法显著提升感知性能。WHALES弥合了仿真与真实V2X挑战间的差距,为感知-调度协同设计、跨数据集泛化及可扩展性极限研究提供坚实框架。数据集与代码已开源:https://github.com/chensiweiTHU/WHALES。

原文摘要 · Abstract (English)

Cooperative perception research is hindered by the limited availability of datasets that capture the complexity of real-world Vehicle-to-Everything (V2X) interactions, particularly under dynamic communication constraints. To address this gap, we introduce WHALES (Wireless enhanced Autonomous vehicles with Large number of Engaged agents), the first large-scale V2X dataset explicitly designed to benchmark communication-aware agent scheduling and scalable cooperative perception. WHALES introduces a new benchmark that enables state-of-the-art (SOTA) research in communication-aware cooperative perception, featuring an average of 8.4 cooperative agents per scene and 2.01 million annotated 3D objects across diverse traffic scenarios. It incorporates detailed communication metadata to emulate real-world communication bottlenecks, enabling rigorous evaluation of scheduling strategies. To further advance the field, we propose the Coverage-Aware Historical Scheduler (CAHS), a novel scheduling baseline that selects agents based on historical viewpoint coverage, improving perception performance over existing SOTA methods. WHALES bridges the gap between simulated and real-world V2X challenges, providing a robust framework for exploring perception-scheduling co-design, cross-data generalization, and scalability limits. The WHALES dataset and code are available at https://github.com/chensiweiTHU/WHALES.

自动驾驶多智能体协同感知数据集

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。