用伪标签提升小模型在边缘设备上的多任务避障能力
Instance-Aware Knowledge Distillation for Semi-Supervised Learning of an On-Board Multi-Task Dense Prediction Model for Collision Avoidance System

- 基于领域先验和基础模型,生成减轻教师偏差的伪标签
- 小模型在实例分割上超越大模型,深度估计更稳定
- 适合部署在低算力边缘设备的实时避障系统
碰撞避让系统正向基于摄像头的深度学习方法演进,以实现驾驶场景理解。然而,在乡村俱乐部等边缘环境部署时,受限于计算资源有限和通信基础设施不可靠。此外,构建目标域的大规模数据集需付出高昂标注成本。为解决这些问题,我们提出一种面向半监督学习的实例感知知识蒸馏框架。具体而言,通过利用教师模型的领域先验和基础模型的实例中心知识,生成缓解教师偏差的伪标签。训练后的轻量级学生模型被部署于所提出的碰撞避让系统中,可实时执行多项密集预测任务。系统检测前方障碍物,并将其空间信息编码为控制器局域网络消息,用于自动导引车辆运行。为此,我们构建了一个大规模乡村俱乐部数据集,并对系统进行了实地验证。实验结果表明,学生模型在实例分割上优于大型教师模型,同时缓解了单目深度估计性能下降的问题。与教师模型相比,学生模型减少22.68倍浮点运算量、14.33倍参数量,在低成本边缘设备上达到6.46帧每秒。
原文摘要 · Abstract (English)
Collision avoidance systems have evolved toward camera-based deep learning approaches for driving scene understanding. However, deployment in edge environments such as country clubs is constrained by limited computational resources and unreliable communication infrastructure. Moreover, constructing large-scale datasets for the target domain involves substantial annotation cost. To address these limitations, we propose an instance-aware knowledge distillation framework for semi-supervised learning. Specifically, we generate pseudo labels that mitigate teacher bias by leveraging domain priors from the teacher and instance-centric knowledge from foundation models. The trained lightweight student is deployed in the proposed collision avoidance system and performs multiple dense prediction tasks in real-time. The system detects frontal obstacles and encodes their spatial information into controller area network messages for automated guided vehicle operation. To achieve this, we construct a large-scale country club dataset and perform field validation of the proposed system. Experimental results demonstrate that the student outperforms the large teacher in instance segmentation while mitigating performance degradation in monocular depth estimation. Compared with the teacher, the student reduces FLOPs by 22.68$\times$ and parameters by 14.33$\times$, achieving 6.46 FPS on a low-cost edge device.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。