arXiv:2512.22298cs.CVcs.HC2025-12

在低成本硬件上实现低延迟的车内驾驶行为实时识别。

Real-Time In-Cabin Driver Behavior Recognition on Low-Cost Edge Hardware

  • 采用轻量视觉模型+时序决策机制,提升识别稳定性。
  • 可在树莓派5上达16帧/秒, Coral TPU上达25帧/秒。
  • 适合车载系统部署,支持17类驾驶行为识别。

车内驾驶员监控系统(DMS)需在计算、功耗和成本严格受限的条件下,以低延迟识别分心与困倦相关行为。本文提出一种单摄像头车内行为识别系统,适用于树莓派5(仅CPU)和谷歌Coral开发板(配备边缘张量处理单元,Edge TPU)两类低成本边缘平台。该系统包含三部分:(i) 轻量化逐帧视觉模型,(ii) 能减少视觉相似行为混淆的干扰感知标签体系,(iii) 仅当预测既置信又持续时才触发警报的时序决策头。系统支持17种行为类别。训练与评估使用授权数据集及自建数据集(超过80万标注帧),采用驾驶员独立划分。进一步在实车环境中验证了部署效果。端到端性能在树莓派5上达到约16 FPS(INT8推理,每帧延迟<60毫秒),在Coral Edge TPU上达约25 FPS(端到端延迟~40毫秒),实现嵌入式硬件上的实时监测与稳定告警。最后讨论了可靠车内感知如何作为人本车辆智能的上游信号,支撑新兴代理式车辆概念。

原文摘要 · Abstract (English)

In-cabin driver monitoring systems (DMS) must recognize distraction- and drowsiness-related behaviors with low latency under strict constraints on compute, power, and cost. We present a single-camera in-cabin driver behavior recognition system designed for deployment on two low-cost edge platforms: Raspberry Pi 5 (CPU-only) and the Google Coral development board with an Edge Tensor Processing Unit (Edge TPU) accelerator. The proposed pipeline combines (i) a compact per-frame vision model, (ii) a confounder-aware label taxonomy to reduce confusions among visually similar behaviors, and (iii) a temporal decision head that triggers alerts only when predictions are both confident and sustained. The system supports 17 behavior classes. Training and evaluation use licensed datasets plus in-house collection (over 800,000 labeled frames) with driver-disjoint splits, and we further validate the deployed system in live in-vehicle tests. End-to-end performance reaches approximately 16 FPS on Raspberry Pi 5 using 8-bit integer (INT8) inference (per-frame latency <60 ms) and approximately 25 FPS on Coral Edge TPU (end-to-end latency ~40 ms), enabling real-time monitoring and stable alert generation on embedded hardware. Finally, we discuss how reliable in-cabin perception can serve as an upstream signal for human-centered vehicle intelligence, including emerging agentic vehicle concepts.

行为识别边缘计算智能座舱

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。