arXiv:2508.00287cs.CV2025-08被引 2

用联邦学习和注意力机制实现隐私保护下的疲劳驾驶检测

Privacy-Preserving Driver Drowsiness Detection with Spatial Self-Attention and Federated Learning

  • 结合空间自注意力与LSTM提取关键面部特征
  • 联邦学习下准确率达89.9%,优于现有方法
  • 适合车联网、智能交通等注重隐私的场景

疲劳驾驶是交通事故的主要诱因之一,也是交通死亡事故的重要因素。然而,在真实场景中,个体面部数据分散且差异大,准确检测仍具挑战。本文提出一种新型疲劳检测框架,适用于异构和分散的数据。该框架引入空间自注意力(SSA)机制与长短期记忆(LSTM)网络,更有效提取关键面部特征,提升检测性能。为支持联邦学习,采用梯度相似性比较(GSC)机制,在聚合前筛选最具相关性的模型,增强全局模型的准确性和鲁棒性,同时保护用户隐私。此外,开发了定制化工具,自动处理视频数据:提取帧、检测并裁剪人脸,并应用旋转、翻转、亮度调整、缩放等数据增强技术。实验结果表明,该框架在联邦学习设置下达到89.9%的检测准确率,在多种部署场景中均优于现有方法,验证了其应对真实世界数据多样性的有效性,展现了在智能交通系统中提升道路安全的潜力。

原文摘要 · Abstract (English)

Driver drowsiness is one of the main causes of road accidents and is recognized as a leading contributor to traffic-related fatalities. However, detecting drowsiness accurately remains a challenging task, especially in real-world settings where facial data from different individuals is decentralized and highly diverse. In this paper, we propose a novel framework for drowsiness detection that is designed to work effectively with heterogeneous and decentralized data. Our approach develops a new Spatial Self-Attention (SSA) mechanism integrated with a Long Short-Term Memory (LSTM) network to better extract key facial features and improve detection performance. To support federated learning, we employ a Gradient Similarity Comparison (GSC) that selects the most relevant trained models from different operators before aggregation. This improves the accuracy and robustness of the global model while preserving user privacy. We also develop a customized tool that automatically processes video data by extracting frames, detecting and cropping faces, and applying data augmentation techniques such as rotation, flipping, brightness adjustment, and zooming. Experimental results show that our framework achieves a detection accuracy of 89.9% in the federated learning settings, outperforming existing methods under various deployment scenarios. The results demonstrate the effectiveness of our approach in handling real-world data variability and highlight its potential for deployment in intelligent transportation systems to enhance road safety through early and reliable drowsiness detection.

疲劳检测联邦学习隐私保护视觉分析

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。