构建首个连续40分钟的多模态困倦驾驶数据集,涵盖面部、生理与行为信号。
UL-DD: A Multimodal Drowsiness Dataset Using Video, Biometric Signals, and Behavioral Data
- 融合深度摄像头、红外影像、生物信号与方向盘压力等多源数据
- 19名受试者在模拟驾驶中采集共1400分钟连续数据,每4分钟自评困倦程度
- 适合做驾驶困倦检测、多模态融合与连续状态建模的研究者使用
本研究提出一个用于驾驶员困倦检测的综合性公开数据集,整合了面部、行为与生物特征等多种模态信号。数据集包含深度相机采集的3D面部视频、红外摄像头画面、后视视频,以及心率、皮电活动、血氧饱和度、皮肤温度和加速度计数据。同时记录方向盘握力传感器数据及美国卡车模拟游戏的行车数据,以捕捉警觉与困倦状态下的驾驶行为差异。困倦程度通过每4分钟一次的卡罗林斯卡嗜睡量表(KSS)自评获得。实验在三屏模拟环境中进行,驾驶条件完全模拟真实车辆。数据来自19名受试者(15名男性,4名女性),分别在完全清醒和出现困倦迹象两种状态下采集。不同于其他数据集,本数据集每名受试者每次采集持续40分钟,总计达1,400分钟,记录了驾驶员状态的渐进变化,而非离散的清醒/困倦标签。旨在建立覆盖更广生理、行为与驾驶相关信号的多模态困倦数据集。数据集将根据需求向通讯作者申请获取。
原文摘要 · Abstract (English)
In this study, we present a comprehensive public dataset for driver drowsiness detection, integrating multimodal signals of facial, behavioral, and biometric indicators. Our dataset includes 3D facial video using a depth camera, IR camera footage, posterior videos, and biometric signals such as heart rate, electrodermal activity, blood oxygen saturation, skin temperature, and accelerometer data. This data set provides grip sensor data from the steering wheel and telemetry data from the American truck simulator game to provide more information about drivers' behavior while they are alert and drowsy. Drowsiness levels were self-reported every four minutes using the Karolinska Sleepiness Scale (KSS). The simulation environment consists of three monitor setups, and the driving condition is completely like a car. Data were collected from 19 subjects (15 M, 4 F) in two conditions: when they were fully alert and when they exhibited signs of sleepiness. Unlike other datasets, our multimodal dataset has a continuous duration of 40 minutes for each data collection session per subject, contributing to a total length of 1,400 minutes, and we recorded gradual changes in the driver state rather than discrete alert/drowsy labels. This study aims to create a comprehensive multimodal dataset of driver drowsiness that captures a wider range of physiological, behavioral, and driving-related signals. The dataset will be available upon request to the corresponding author.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。