提出多模态方法提升分心驾驶检测的鲁棒性,突破纯视觉模型局限。
Visual Dominance and Emerging Multimodal Approaches in Distracted Driving Detection: A Review of Machine Learning Techniques
- 融合视觉、生理与车载数据,构建多模态检测框架
- 多模态模型准确率显著高于单一视觉模型,提升真实场景适应性
- 适合自动驾驶与智能座舱安全系统研发人员参考
分心驾驶仍是全球道路伤害和死亡的主要原因,即便在驾驶员监控技术进步的背景下。近年来机器学习(ML)与深度学习(DL)主要依赖视觉数据检测分心行为,常忽视驾驶行为的复杂多模态特性。本系统综述分析了2019至2024年间74篇同行评审论文,涵盖视觉、传感器、多模态及新兴模态下的ML/DL方法。研究发现,视觉单模态模型(如CNN与时序架构)虽准确率高,但泛化能力差;生理与车载传感器模型可补充内部状态与车辆动态信息;新兴技术如听觉感知与射频(RF)方法提供隐私友好替代方案。多模态架构始终优于单模态基线,展现出更强鲁棒性、情境感知与可扩展性。结论强调应超越纯视觉方法,采用融合视觉、生理与车辆信号的多模态系统,并平衡计算开销。未来研究应聚焦轻量化部署框架、个性化基准与跨模态评估标准,以保障高级驾驶辅助系统(ADAS)与道路安全干预的真实可靠性。
原文摘要 · Abstract (English)
Distracted driving continues to be a significant cause of road traffic injuries and fatalities worldwide, even with advancements in driver monitoring technologies. Recent developments in machine learning (ML) and deep learning (DL) have primarily focused on visual data to detect distraction, often neglecting the complex, multimodal nature of driver behavior. This systematic review assesses 74 peer-reviewed studies from 2019 to 2024 that utilize ML/DL techniques for distracted driving detection across visual, sensor-based, multimodal, and emerging modalities. The review highlights a significant prevalence of visual-only models, particularly convolutional neural networks (CNNs) and temporal architectures, which achieve high accuracy but show limited generalizability in real-world scenarios. Sensor-based and physiological models provide complementary strengths by capturing internal states and vehicle dynamics, while emerging techniques, such as auditory sensing and radio frequency (RF) methods, offer privacy-aware alternatives. Multimodal architecture consistently surpasses unimodal baselines, demonstrating enhanced robustness, context awareness, and scalability by integrating diverse data streams. These findings emphasize the need to move beyond visual-only approaches and adopt multimodal systems that combine visual, physiological, and vehicular cues while keeping in checking the need to balance computational requirements. Future research should focus on developing lightweight, deployable multimodal frameworks, incorporating personalized baselines, and establishing cross-modality benchmarks to ensure real-world reliability in advanced driver assistance systems (ADAS) and road safety interventions.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。