WhisperNet通过动态分配共享内容与位置,实现高效协同感知。
WhisperNet: A Scalable Solution for Bandwidth-Efficient Collaboration
- 接收端主导全局请求,动态分配各智能体的特征贡献
- 通信成本仅0.5%时,检测精度提升2.4%(OPV2V)
- 适合自动驾驶多车协同场景,抗定位噪声能力强
协同感知对自动驾驶至关重要,但受限于通信带宽。现有方法多采用固定速率编码压缩特征图,或基于目标区域选择提升效率,但前者适应性差,后者易丢失全局上下文。为此,我们提出WhisperNet,一种面向带宽的接收端主导框架,发送端仅传输轻量级显著性元数据,接收端生成全局请求计划,动态分配各智能体与特征的贡献,仅召回最相关信息。协作特征路由模块在融合前对齐相关消息,保证结构一致性。大量实验表明,WhisperNet在仅0.5%通信成本下,使OPV2V上[email protected]提升2.4%,作为即插即用组件,在仅需5%完整带宽时仍能提升强基线性能,并保持对定位噪声的鲁棒性。结果证明,跨‘内容’与‘位置’的全局协调分配是高效协同感知的关键。
原文摘要 · Abstract (English)
Collaborative perception is vital for autonomous driving yet remains constrained by tight communication budgets. Earlier work reduced bandwidth by compressing full feature maps with fixed-rate encoders, which adapts poorly to a changing environment, and it further evolved into spatial selection methods that improve efficiency by focusing on salient regions, but this object-centric approach often sacrifices global context, weakening holistic scene understanding. To overcome these limitations, we introduce \textit{WhisperNet}, a bandwidth-aware framework that proposes a novel, receiver-centric paradigm for global coordination across agents. Senders generate lightweight saliency metadata, while the receiver formulates a global request plan that dynamically budgets feature contributions across agents and features, retrieving only the most informative features. A collaborative feature routing module then aligns related messages before fusion to ensure structural consistency. Extensive experiments show that WhisperNet achieves state-of-the-art performance, improving [email protected] on OPV2V by 2.4\% with only 0.5\% of the communication cost. As a plug-and-play component, it boosts strong baselines with merely 5\% of full bandwidth while maintaining robustness under localization noise. These results demonstrate that globally-coordinated allocation across \textit{what} and \textit{where} to share is the key to achieving efficient collaborative perception.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。