通过解耦与对比学习,提升跨摄像头驾驶分心识别的鲁棒性。
Cross-Camera Distracted Driver Classification through Feature Disentanglement and Contrastive Learning
- 用特征解耦去除摄像头视角干扰,结合对比学习增强行为编码。
- 在多个数据集上实现7%的准确率提升,跨摄像头泛化能力更强。
- 轻量模型适合边缘设备部署,低功耗且推理速度快。
驾驶分心分类对行车安全至关重要。以往研究证明神经网络可有效自动预测驾驶分心、疲劳及潜在危险,但近期发现模型在训练数据之外的拍摄条件下准确率显著下降。本文提出一种抗摄像头位置变化的鲁棒模型——驾驶员行为监控网络(DBMNet),采用轻量级主干网络,集成特征解耦模块以剔除摄像头视角信息,并结合对比学习增强不同驾驶行为的特征表示。在100-驾驶员数据集的昼夜子集上,采用留一摄像头排除协议的实验验证了方法有效性。跨数据集和跨摄像头实验在AUCDD-V1、EZZ2021和SFD三个基准数据集上均表明,所提方法具备更优的泛化性能。总体上,相较于现有高效方法,DBMNet在Top-1准确率上提升7%。此外,将DBMNet及其对比方法量化后部署于Coral Dev Board,DBMNet在保持紧凑模型规模、低内存占用、快速推理与极低功耗的同时,实现了最低平均误差。
原文摘要 · Abstract (English)
The classification of distracted drivers is pivotal for ensuring safe driving. Previous studies demonstrated the effectiveness of neural networks in automatically predicting driver distraction, fatigue, and potential hazards. However, recent research has uncovered a significant loss of accuracy in these models when applied to samples acquired under conditions that differ from the training data. In this paper, we introduce a robust model designed to withstand changes in camera position within the vehicle. Our Driver Behavior Monitoring Network (DBMNet) relies on a lightweight backbone and integrates a disentanglement module to discard camera view information from features, coupled with contrastive learning to enhance the encoding of various driver actions. Experiments conducted using a leave-one-camera-out protocol on the daytime and nighttime subsets of the 100-Driver dataset validate the effectiveness of our approach. Cross-dataset and cross-camera experiments conducted on three benchmark datasets, namely AUCDD-V1, EZZ2021 and SFD, demonstrate the superior generalization capabilities of the proposed method. Overall DBMNet achieves an improvement of 7% in Top-1 accuracy compared to existing efficient approaches. Moreover, a quantized version of the DBMNet and all considered methods has been deployed on a Coral Dev Board board. In this deployment scenario, DBMNet outperforms alternatives, achieving the lowest average error while maintaining a compact model size, low memory footprint, fast inference time, and minimal power consumption.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。