arXiv:2507.01274cs.HCcs.AI2025-07中稿 · and Presented at 1…被引 2

用AI客观评估海员训练表现,提升安全与应急准备能力

AI Meets Maritime Training: Precision Analytics for Enhanced Safety and Performance

  • 融合眼动追踪、语音识别与声调分析,实现多模态行为检测
  • 视觉检测准确率92%,语音识别达91%,压力识别90%以上
  • 适合海事培训、安全评估及个性化反馈场景

传统海事模拟训练依赖教练主观评估技术能力、行为专注度、沟通与肢体语言,存在主观性强、关键特征难量化、认知负荷大等问题。本研究提出一种AI驱动框架,通过眼动追踪、瞳孔变化与计算机视觉分析视觉注意力;基于专用于海事领域的语音转文字模型与自然语言处理分析沟通内容;利用大语言模型判断沟通正确性;通过声调频率检测心理压力。系统在模拟海事场景中对海员进行高压力事件测试,各项算法表现优异:视觉检测准确率约92%,海事语音识别约91%,压力检测约90%,均优于现有基准。系统可提供视觉注意力分布、检查单遵循度及高压下的应激水平等量化指标。研究表明,AI能实现海事训练的客观性能分析,支持个性化反馈,显著提升真实操作中的应对准备度。

原文摘要 · Abstract (English)

Traditional simulator-based training for maritime professionals is critical for ensuring safety at sea but often depends on subjective trainer assessments of technical skills, behavioral focus, communication, and body language, posing challenges such as subjectivity, difficulty in measuring key features, and cognitive limitations. Addressing these issues, this study develops an AI-driven framework to enhance maritime training by objectively assessing trainee performance through visual focus tracking, speech recognition, and stress detection, improving readiness for high-risk scenarios. The system integrates AI techniques, including visual focus determination using eye tracking, pupil dilation analysis, and computer vision; communication analysis through a maritime-specific speech-to-text model and natural language processing; communication correctness using large language models; and mental stress detection via vocal pitch. Models were evaluated on data from simulated maritime scenarios with seafarers exposed to controlled high-stress events. The AI algorithms achieved high accuracy, with ~92% for visual detection, ~91% for maritime speech recognition, and ~90% for stress detection, surpassing existing benchmarks. The system provides insights into visual attention, adherence to communication checklists, and stress levels under demanding conditions. This study demonstrates how AI can transform maritime training by delivering objective performance analytics, enabling personalized feedback, and improving preparedness for real-world operational challenges.

海事训练AI评估多模态分析

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。