让自动驾驶车辆主动判断传什么,提升信息共享效率。
Reason-to-Transmit: Deliberative Adaptive Communication for Cooperative Perception
- 基于轻量Transformer推理每个区域是否该传输
- 高遮挡下性能接近理想通信,比无通信提升58%检测率
- 适合车联网中带宽受限、遮挡严重的复杂场景
自动驾驶车辆间协作感知可突破单机传感局限,但车联网络带宽受限,需高效通信策略。现有方法依赖置信度图、学习门控或稀疏掩码等反应式机制,未考虑发送信息对接收方的实际价值。本文提出Reason-to-Transmit(R2T)框架,为每台设备配备轻量级Transformer模块,综合本地场景上下文、邻近信息差距估计与带宽预算,做出逐区域的传输决策。采用端到端训练,以带宽感知为目标函数,在多智能体鸟瞰视角感知环境中对比九种基线。有通信时检测精度(AP)相较无通信提升约58%。低带宽下各选择性方法表现相近,但在高遮挡场景中R2T优势显著,逼近理想通信(oracle)性能。所有方法在丢包率高达50%时仍能平稳退化,表现出良好鲁棒性。结果表明,虽融合设计主导性能,但理性通信在挑战性场景中仍具额外增益。R2T引入基于推理的通信范式,实现更高效、上下文感知的信息共享。
原文摘要 · Abstract (English)
Cooperative perception among autonomous agents overcomes the limitations of single-agent sensing, but bandwidth constraints in vehicle-to-everything (V2X) networks require efficient communication policies. Existing approaches rely on reactive mechanisms, such as confidence maps, learned gating, or sparse masks, to decide what to transmit, without reasoning about why a message benefits the receiver. We introduce Reason-to-Transmit (R2T), a framework that equips each agent with a lightweight transformer-based module that reasons over local scene context, estimated neighbor information gaps, and bandwidth budget to make per-region transmission decisions. Trained end-to-end with a bandwidth-aware objective, R2T is evaluated against nine baselines in a multi-agent bird's-eye-view perception environment. Any communication improves performance by about 58% AP over no communication. At low bandwidth, all selective methods perform similarly, but R2T shows clear gains under high occlusion, where information asymmetry is greatest, approaching oracle performance. All methods degrade gracefully under packet drops up to 50%, showing robustness to communication failures. These results indicate that while fusion design dominates performance, deliberative communication provides additional gains in challenging scenarios. R2T introduces a reasoning-based approach to communication, enabling more efficient and context-aware information sharing in cooperative perception.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。