融合多源异构数据,提升真实场景下疲劳检测精度
Enhancing Fatigue Detection through Heterogeneous Multi-Source Data Integration and Cross-Domain Modality Imputation
- 利用跨域模态补全技术整合不同来源的传感器数据
- 在真实环境中实现比传统方法更高鲁棒性的疲劳识别
- 适合需要高可靠性人机交互安全系统的研发人员
针对航空、采矿、长途运输等安全相关领域中操作员疲劳检测的需求,本文提出一种面向实际部署环境的疲劳检测框架。在真实场景中,高精度传感器常因噪声、光照和视角限制导致性能下降,难以可靠采集疲劳信号。为此,本文构建了一个基于异构源域知识的多源数据融合系统:利用实验室中易部署但难以现场使用的高保真传感器数据,通过共享模态驱动的跨域模态补全机制,辅助目标域中可用模态的数据增强与缺失补全。该方法显著提升了复杂环境下疲劳状态估计的稳定性与准确性。
原文摘要 · Abstract (English)
Fatigue detection for human operators is important in safety-related applications such as aviation, mining, and long-haul transport. Reliable estimation of operator fatigue can support timely warnings, adaptive task scheduling, takeover reminders, and other safety-management decisions in human-machine systems. However, the effectiveness of these functions depends on whether fatigue-related signals can be reliably captured in the deployment environment. While many studies have shown the value of high-fidelity sensors in controlled laboratory environments, their performance often degrades when used in real-world settings because of noise, lighting conditions, and field-of-view constraints, thereby limiting their practical use. This paper formalizes a deployment-oriented setting for real-world fatigue detection, where high-quality sensors are often unavailable in practical applications. To address this issue, we use knowledge from heterogeneous source domains, including high-fidelity sensors that are difficult to deploy in the field but commonly used in controlled environments, to assist fatigue detection in the real-world target domain. Based on this idea, we design a heterogeneous and multi-source fatigue-detection framework that uses the available modalities in the target domain while leveraging diverse configurations in the source domains through cross-domain modality imputation based on shared modalities.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。