用人体姿态引导注意力,实时预测点球方向
Predicting Penalty Kick Direction Using Multi-Modal Deep Learning with Pose-Guided Attention
- 双路模型:视觉+姿态关键点融合分析
- 89%准确率,比纯视觉或纯姿态方法高14-22%
- 22毫秒推理速度,适合训练和实战分析
点球常决定比赛胜负,守门员需在极短时间内从细微生物力学线索中预判射门方向。本文提出一种实时多模态深度学习框架,预测点球方向(左、中、右)于触球前。模型采用双分支结构:基于MobileNetV2的CNN提取RGB帧空间特征,2D关键点通过带注意力机制的LSTM处理;姿态信息引导视觉关注任务相关区域。采用基于距离的阈值法,在触球前截取一致输入序列。构建了包含755个点球事件的自定义数据集,含逐帧目标检测、射门者关键点与最终球落点标注。模型在独立测试集上达到89%准确率,优于纯视觉与纯姿态基线14-22%。仅需22毫秒推理时间,轻量且可解释,适用于守门员训练、战术分析与实时比赛数据洞察。
原文摘要 · Abstract (English)
Penalty kicks often decide championships, yet goalkeepers must anticipate the kicker's intent from subtle biomechanical cues within a very short time window. This study introduces a real-time, multi-modal deep learning framework to predict the direction of a penalty kick (left, middle, or right) before ball contact. The model uses a dual-branch architecture: a MobileNetV2-based CNN extracts spatial features from RGB frames, while 2D keypoints are processed by an LSTM network with attention mechanisms. Pose-derived keypoints further guide visual focus toward task-relevant regions. A distance-based thresholding method segments input sequences immediately before ball contact, ensuring consistent input across diverse footage. A custom dataset of 755 penalty kick events was created from real match videos, with frame-level annotations for object detection, shooter keypoints, and final ball placement. The model achieved 89% accuracy on a held-out test set, outperforming visual-only and pose-only baselines by 14-22%. With an inference time of 22 milliseconds, the lightweight and interpretable design makes it suitable for goalkeeper training, tactical analysis, and real-time game analytics.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。