轻量级驾驶行为识别模型,动态聚焦关键区域提升效率与泛化能力。
C-DIRA: Computationally Efficient Dynamic ROI Routing and Domain-Invariant Adversarial Learning for Lightweight Driver Behavior Recognition
- 动态选择高难度样本进行区域推理,减少计算开销。
- 在State Farm数据集上比现有轻量模型少37%浮点运算,延迟更低。
- 对不同驾驶员和光照条件变化有强鲁棒性,适合边缘设备部署。
基于车载摄像头的驾驶分心行为识别需在边缘设备实现实时推理。然而,轻量模型常因无法捕捉细微行为线索,导致在未见驾驶员或不同环境下性能下降。基于感兴趣区域(ROI)的方法虽提升精度,但增加计算负担,难以兼顾效率与准确率。本文提出一种轻量级框架C-DIRA,结合显著性驱动的Top-K ROI池化与融合分类,实现局部特征提取与整合。动态ROI路由机制仅对高难度样本执行区域推理,实现选择性计算。同时,通过伪域标签与对抗学习,学习对驾驶员和背景变化具有鲁棒性的域不变特征。在State Farm Distracted Driver Detection Dataset上的实验表明,C-DIRA在保持高准确率的同时,浮点运算量显著低于先前轻量模型,延迟更低;在模糊、低光等视觉退化条件下仍表现稳定,跨域性能优异。结果验证了其在紧凑性、高效性与泛化能力上的有效性。
原文摘要 · Abstract (English)
Driver distraction behavior recognition using in-vehicle cameras demands real-time inference on edge devices. However, lightweight models often fail to capture fine-grained behavioral cues, resulting in reduced performance on unseen drivers or under varying conditions. ROI-based methods also increase computational cost, making it difficult to balance efficiency and accuracy. This work addresses the need for a lightweight architecture that overcomes these constraints. We propose Computationally efficient Dynamic region of Interest Routing and domain-invariant Adversarial learning for lightweight driver behavior recognition (C-DIRA). The framework combines saliency-driven Top-K ROI pooling and fused classification for local feature extraction and integration. Dynamic ROI routing enables selective computation by applying ROI inference only to high difficulty data samples. Moreover, pseudo-domain labeling and adversarial learning are used to learn domain-invariant features robust to driver and background variation. Experiments on the State Farm Distracted Driver Detection Dataset show that C-DIRA maintains high accuracy with significantly fewer FLOPs and lower latency than prior lightweight models. It also demonstrates robustness under visual degradation such as blur and low-light, and stable performance across unseen domains. These results confirm C-DIRA's effectiveness in achieving compactness, efficiency, and generalization.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。