一个解释器搞定多种传感器,让自动驾驶车共享感知更高效。
One is Plenty: A Polymorphic Feature Interpreter for Immutable Heterogeneous Collaborative Perception
- 用可复写的提示词实现单一解释器适配多类车辆
- 在OPV2V上提升感知精度11.1%,仅需更新1.4%参数
- 适合做异构车载系统协作的工程师和研究者
自动驾驶中的协同感知能显著提升个体智能体的感知能力。然而,在感知网络固定不变的异构场景下,由于交换的中间特征存在语义鸿沟,传统方法面临挑战。现有方法要么需为每种新设备训练全新解释器,难以扩展;要么依赖两级语义空间转换,导致累积语义损失。为此,本文提出PolyInter——一种多态特征解释器。它通过可重写提示词作为扩展点,使新设备仅需更新其专属提示词即可接入,其余参数保持不变。利用多态设计,单一解释器可无缝兼容多种异构设备,并将它们的特征精准映射到本车语义空间。在OPV2V数据集上的实验表明,PolyInter相比当前最优方法提升协同感知精度达11.1%,且适配新设备时仅需训练1.4%的参数。代码已开源。
原文摘要 · Abstract (English)
Collaborative perception in autonomous driving significantly enhances the perception capabilities of individual agents. Immutable heterogeneity, where agents have different and fixed perception networks, presents a major challenge due to the semantic gap in exchanged intermediate features without modifying the perception networks. Most existing methods bridge the semantic gap through interpreters. However, they either require training a new interpreter for each new agent type, limiting extensibility, or rely on a two-stage interpretation via an intermediate standardized semantic space, causing cumulative semantic loss. To achieve both extensibility in immutable heterogeneous scenarios and low-loss feature interpretation, we propose PolyInter, a polymorphic feature interpreter. It provides an extension point where new agents integrate by overriding only their specific prompts, which are learnable parameters that guide interpretation, while reusing PolyInter's remaining parameters. By leveraging polymorphism, our design enables a single interpreter to accommodate diverse agents and interpret their features into the ego agent's semantic space. Experiments on the OPV2V dataset demonstrate that PolyInter improves collaborative perception precision by up to 11.1% compared to SOTA interpreters, while comparable results can be achieved by training only 1.4% of PolyInter's parameters when adapting to new agents. Code is available at https://github.com/yuchen-xia/PolyInter.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。