首个车内多模态生物识别数据集,支持驾驶人身份验证研究。
in-Car Biometrics (iCarB) Datasets for Driver Recognition: Face, Fingerprint, and Voice
- 采集200名志愿者车内人脸、指纹、语音数据,含近红外相机与双麦克风。
- 包含真实场景干扰数据,支持评估系统在非理想条件下的性能。
- 覆盖全肤色、性别与年龄范围,适合研究生物识别公平性问题。
本文发布三个车内生物识别数据集(iCarB-Face、iCarB-Fingerprint、iCarB-Voice),涵盖从200名自愿者在车内驾驶位采集的人脸视频、指纹图像和语音样本。数据通过近红外相机、两个指纹扫描仪和两个麦克风获取,车辆停泊于室内外环境,并引入多种干扰模拟真实驾驶场景中非理想采集条件。这些数据集虽专为车载生物识别设计,但适用范围更广:可评估与基准面部、指纹、语音识别系统;构建多模态伪身份以训练/测试融合算法;生成呈现攻击样本用于检测算法评估;结合元数据研究生物识别系统中的人口与环境偏差。据我们所知,iCarB是目前最大且最多样化的公开车载生物识别数据集,包含三种模态且同环境采集,其中iCarB-Fingerprint为首个公开的车载指纹数据集。数据集包含50/50性别比例、菲茨帕特里克肤色谱系全覆盖及18-60岁以上广泛年龄分布,具有罕见的多样性,对推动生物识别研究具有重要价值。
原文摘要 · Abstract (English)
We present three biometric datasets (iCarB-Face, iCarB-Fingerprint, iCarB-Voice) containing face videos, fingerprint images, and voice samples, collected inside a car from 200 consenting volunteers. The data was acquired using a near-infrared camera, two fingerprint scanners, and two microphones, while the volunteers were seated in the driver's seat of the car. The data collection took place while the car was parked both indoors and outdoors, and different "noises" were added to simulate non-ideal biometric data capture that may be encountered in real-life driver recognition. Although the datasets are specifically tailored to in-vehicle biometric recognition, their utility is not limited to the automotive environment. The iCarB datasets, which are available to the research community, can be used to: (i) evaluate and benchmark face, fingerprint, and voice recognition systems (we provide several evaluation protocols); (ii) create multimodal pseudo-identities, to train/test multimodal fusion algorithms; (iii) create Presentation Attacks from the biometric data, to evaluate Presentation Attack Detection algorithms; (iv) investigate demographic and environmental biases in biometric systems, using the provided metadata. To the best of our knowledge, ours are the largest and most diverse publicly available in-vehicle biometric datasets. Most other datasets contain only one biometric modality (usually face), while our datasets consist of three modalities, all acquired in the same automotive environment. Moreover, iCarB-Fingerprint seems to be the first publicly available in-vehicle fingerprint dataset. Finally, the iCarB datasets boast a rare level of demographic diversity among the 200 data subjects, including a 50/50 gender split, skin colours across the whole Fitzpatrick-scale spectrum, and a wide age range (18-60+). So, these datasets will be valuable for advancing biometrics research.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。