用轻量辅助网络缩小纯摄像头模型与激光雷达融合模型的差距
BridgeTA: Bridging the Representation Gap in Knowledge Distillation via Teacher Assistant for Bird's Eye View Map Segmentation
- 引入轻量级教师助手网络构建共享表征空间
- 在nuScenes上提升4.2% mIoU,优于主流知识蒸馏方法45%
- 无需改变学生模型结构,推理成本不变,适合部署场景
鸟瞰图(BEV)地图分割是自动驾驶中关键且具有挑战性的任务。纯摄像头方案作为低成本替代方案受到关注,但仍落后于激光雷达-相机融合方法。知识蒸馏(KD)被用于缩小这一差距,但现有方法主要通过模仿教师模型结构来扩大学生模型,导致推理开销增加。为此,本文提出BridgeTA,一种通过教师助手(TA)网络在保持学生模型结构和推理成本不变的前提下,弥合激光雷达-相机融合与纯摄像头模型之间表征差距的高效蒸馏框架。轻量级TA网络融合教师与学生的BEV表征,构建共享潜在空间作为中间表示。理论层面,基于Young不等式推导蒸馏损失,将直接的师生蒸馏路径分解为教师-TA与TA-学生双路径,稳定优化并增强知识迁移。在具有挑战性的nuScenes数据集上的大量实验表明,该方法相较纯摄像头基线提升4.2% mIoU,性能提升幅度比当前最先进的KD方法高出最多45%。
原文摘要 · Abstract (English)
Bird's-Eye-View (BEV) map segmentation is one of the most important and challenging tasks in autonomous driving. Camera-only approaches have drawn attention as cost-effective alternatives to LiDAR, but they still fall behind LiDAR-Camera (LC) fusion-based methods. Knowledge Distillation (KD) has been explored to narrow this gap, but existing methods mainly enlarge the student model by mimicking the teacher's architecture, leading to higher inference cost. To address this issue, we introduce BridgeTA, a cost-effective distillation framework to bridge the representation gap between LC fusion and Camera-only models through a Teacher Assistant (TA) network while keeping the student's architecture and inference cost unchanged. A lightweight TA network combines the BEV representations of the teacher and student, creating a shared latent space that serves as an intermediate representation. To ground the framework theoretically, we derive a distillation loss using Young's Inequality, which decomposes the direct teacher-student distillation path into teacher-TA and TA-student dual paths, stabilizing optimization and strengthening knowledge transfer. Extensive experiments on the challenging nuScenes dataset demonstrate the effectiveness of our method, achieving an improvement of 4.2% mIoU over the Camera-only baseline, up to 45% higher than the improvement of other state-of-the-art KD methods.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。