针对驾驶行为识别中的标签噪声问题,提出首个有效降噪方法。
Exploring Video-Based Driver Activity Recognition under Noisy Labels
- 基于聚类假设学习视频嵌入,分组进行分类器输出平滑。
- 在Drive&Act数据集上显著提升各粒度任务的识别准确率。
- 无需调参的自适应样本筛选,适合真实场景中带噪数据训练。
在深度学习领域,带噪声标签的学习近十年来备受关注且发展迅速。对于驾驶分心行为识别而言,真实视频数据常含误标样本,严重影响模型可靠性与性能,但该问题在驾驶行为识别领域尚未深入研究。本文首次提出适用于驾驶行为识别任务的噪声标签学习方法。基于聚类假设,先使模型从视频中学习聚类友好的低维表示,并将所得嵌入分配至簇内;随后在每个簇内进行协同优化以平滑分类器输出。此外,提出一种灵活的样本选择策略,结合两种标准自动过滤干净样本,无需超参数;同时引入自适应参数,增强类别间平衡性。在公开数据集Drive&Act上,对所有粒度级别进行充分实验,结果表明本方法优于图像分类领域现有去噪方法。源码已开源。
原文摘要 · Abstract (English)
As an open research topic in the field of deep learning, learning with noisy labels has attracted much attention and grown rapidly over the past ten years. Learning with label noise is crucial for driver distraction behavior recognition, as real-world video data often contains mislabeled samples, impacting model reliability and performance. However, label noise learning is barely explored in the driver activity recognition field. In this paper, we propose the first label noise learning approach for the driver activity recognition task. Based on the cluster assumption, we initially enable the model to learn clustering-friendly low-dimensional representations from given videos and assign the resultant embeddings into clusters. We subsequently perform co-refinement within each cluster to smooth the classifier outputs. Furthermore, we propose a flexible sample selection strategy that combines two selection criteria without relying on any hyperparameters to filter clean samples from the training dataset. We also incorporate a self-adaptive parameter into the sample selection process to enforce balancing across classes. A comprehensive variety of experiments on the public Drive&Act dataset for all granularity levels demonstrates the superior performance of our method in comparison with other label-denoising methods derived from the image classification field. The source code is available at https://github.com/ilonafan/DAR-noisy-labels.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。