arXiv:2509.23700cs.CV2025-09ICCV被引 4

提出INSTINCT框架,用实例级交互实现低带宽高精度协同感知

INSTINCT: Instance-Level Interaction Architecture for Query-Based Collaborative Perception

  • 基于查询的实例级交互,动态筛选高质量目标特征
  • 在DAIR-V2X和V2V4Real上分别提升13.23%/33.08%精度
  • 适合自动驾驶多车协同感知场景,尤其关注带宽受限系统

协同感知系统通过融合多智能体传感数据,克服单车在远距离探测和遮挡场景下的局限性,提升检测精度与安全性。然而,频繁协作与实时性要求带来严苛的带宽压力。已有研究证明,基于查询的实例级交互可降低带宽需求并减少人工先验,但当前基于激光雷达的协同感知方法仍发展不足,性能落后于最先进水平。为此,我们提出INSTINCT(实例级交互架构),包含三个核心组件:1)质量感知过滤机制,用于选择高质量实例特征;2)双分支检测路由方案,分离无关与相关协作实例;3)跨车本地实例融合模块,聚合本地混合实例特征。此外,改进真实标注采样技术以支持多样混合实例特征训练。大量实验表明,INSTINCT性能优越:在DAIR-V2X和V2V4Real数据集上,精度分别提升13.23%和33.08%,通信带宽降至最先进方法的1/281和1/264。代码已开源。

原文摘要 · Abstract (English)

Collaborative perception systems overcome single-vehicle limitations in long-range detection and occlusion scenarios by integrating multi-agent sensory data, improving accuracy and safety. However, frequent cooperative interactions and real-time requirements impose stringent bandwidth constraints. Previous works proves that query-based instance-level interaction reduces bandwidth demands and manual priors, however, LiDAR-focused implementations in collaborative perception remain underdeveloped, with performance still trailing state-of-the-art approaches. To bridge this gap, we propose INSTINCT (INSTance-level INteraCtion ArchiTecture), a novel collaborative perception framework featuring three core components: 1) a quality-aware filtering mechanism for high-quality instance feature selection; 2) a dual-branch detection routing scheme to decouple collaboration-irrelevant and collaboration-relevant instances; and 3) a Cross Agent Local Instance Fusion module to aggregate local hybrid instance features. Additionally, we enhance the ground truth (GT) sampling technique to facilitate training with diverse hybrid instance features. Extensive experiments across multiple datasets demonstrate that INSTINCT achieves superior performance. Specifically, our method achieves an improvement in accuracy 13.23%/33.08% in DAIR-V2X and V2V4Real while reducing the communication bandwidth to 1/281 and 1/264 compared to state-of-the-art methods. The code is available at https://github.com/CrazyShout/INSTINCT.

协同感知激光雷达低带宽实例交互

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。