arXiv:2512.23819cs.CVcs.AI2025-12

用视频分析自动评估军事训练中的团队表现,无需额外设备。

Video-Based Performance Evaluation for ECR Drills in Synthetic Training Environments

  • 通过视频提取骨骼、视线和轨迹数据,量化动作与协作
  • 构建任务特异性指标,实现认知与团队表现的客观评分
  • 适用于军事训练复盘,支持可视化反馈与系统集成

有效的城市作战训练需要情境感知和肌肉记忆,通过在真实且可控环境中反复练习形成。关键训练科目“进入并清空房间”(ECR)要求威胁评估、协调配合和封闭空间控制。军方使用合成训练环境(STE)提供可扩展、受控的训练场景。然而,对认知、心理运动和团队协作技能的客观评估仍具挑战性,传统方法依赖昂贵且侵入性的传感器或主观人工观察,限制了可扩展性和准确性。本文提出一种基于视频的评估流程,仅从训练视频中提取性能分析数据,无需额外硬件。利用计算机视觉模型,系统获取2D骨骼、注视向量和运动轨迹。基于这些数据,构建任务特异性指标,衡量心理运动流畅性、情境意识与团队协作。这些指标输入扩展的认知任务分析(CTA)层级结构,采用加权组合生成团队协作与认知的整体绩效评分。我们在真实世界ECR训练中验证该方法,提供可操作的领域特定指标,捕捉个体与团队表现。同时讨论如何通过Gamemaster与通用智能教学框架(GIFT)中的交互式仪表板支持战后复盘,提供直观易懂的反馈。最后指出局限性,包括追踪困难、真值验证问题及方法泛化性,并展望未来工作:拓展至3D视频分析,利用视频分析实现STE内可扩展评估。

原文摘要 · Abstract (English)

Effective urban warfare training requires situational awareness and muscle memory, developed through repeated practice in realistic yet controlled environments. A key drill, Enter and Clear the Room (ECR), demands threat assessment, coordination, and securing confined spaces. The military uses Synthetic Training Environments that offer scalable, controlled settings for repeated exercises. However, automatic performance assessment remains challenging, particularly when aiming for objective evaluation of cognitive, psychomotor, and teamwork skills. Traditional methods often rely on costly, intrusive sensors or subjective human observation, limiting scalability and accuracy. This paper introduces a video-based assessment pipeline that derives performance analytics from training videos without requiring additional hardware. By utilizing computer vision models, the system extracts 2D skeletons, gaze vectors, and movement trajectories. From these data, we develop task-specific metrics that measure psychomotor fluency, situational awareness, and team coordination. These metrics feed into an extended Cognitive Task Analysis (CTA) hierarchy, which employs a weighted combination to generate overall performance scores for teamwork and cognition. We demonstrate the approach with a case study of real-world ECR drills, providing actionable, domain specific metrics that capture individual and team performance. We also discuss how these insights can support After Action Reviews with interactive dashboards within Gamemaster and the Generalized Intelligent Framework for Tutoring (GIFT), providing intuitive and understandable feedback. We conclude by addressing limitations, including tracking difficulties, ground-truth validation, and the broader applicability of our approach. Future work includes expanding analysis to 3D video data and leveraging video analysis to enable scalable evaluation within STEs.

军事训练视频分析行为评估智能教学

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。