arXiv:2509.05913cs.CV2025-09被引 2

用视觉与骨骼数据融合,精准评估运动员肌肉骨骼风险

A fine-grained attention and geometric correspondence model for musculoskeletal risk classification in athletes using multimodal visual and skeletal features

  • 引入细粒度注意力与几何对应模块,融合图像与骨骼坐标特征
  • 在8类风险分类中准确率超93%,误差低于0.12(RMSE)
  • 适合体育医疗AI研究者,可实现实时运动风险预警

肌肉骨骼损伤对运动员构成重大风险,早期评估对预防至关重要。现有方法多针对受控环境,依赖单一数据源,在复杂场景下表现不佳。本文提出ViSK-GAT模型,结合视觉图像与骨骼坐标特征,实现运动员肌肉骨骼风险分类。构建了定制化多模态数据集MusDis-Sports,每样本按快速全身评估(REBA)系统标注为8类风险。模型引入细粒度注意力模块(FGAM)优化单模态特征,及多模态几何对应模块(MGCM)增强跨模态对齐。实验显示所有关键指标均超过93%,概率分布误差的均方根误差(RMSE)为0.1205,平均绝对误差(MAE)为0.0156。模型性能优于现有先进深度学习框架,展现出推动人工智能驱动风险评估、支持及时干预的潜力。

原文摘要 · Abstract (English)

Musculoskeletal disorders pose significant risks to athletes, and early risk assessment is essential for prevention. However, most existing methods are designed for controlled settings and fail to reliably assess risk in complex environments due to their reliance on a single type of data. This research introduces ViSK-GAT (Visual-Skeletal Geometric Attention Transformer), a novel multimodal deep learning framework that classifies musculoskeletal risk using both visual and skeletal coordinate-based features. A custom multimodal dataset (MusDis-Sports) was created by combining images and skeletal coordinates, with each sample labeled into eight risk categories based on the Rapid Entire Body Assessment (REBA) system. ViSK-GAT integrates two innovative modules: the Fine-Grained Attention Module (FGAM), which refines intra-modal features through self-attention before fusion, and the Multimodal Geometric Correspondence Module (MGCM), which enhances cross-modal alignment between image features and coordinates. The model achieved robust performance, with all key metrics exceeding 93%. Probability distribution error metrics also showed a low Root Mean Squared Error (RMSE) of 0.1205 and a Mean Absolute Error (MAE) of 0.0156. ViSK-GAT consistently outperformed state-of-the-art (SOTA) deep learning backbones and showed its potential to advance artificial intelligence-driven musculoskeletal risk assessment and enable timely interventions in sports.

风险评估多模态骨骼分析运动医学

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。