用双向LSTM实时识别健身动作并计数,准确率超99%。
Real-Time Fitness Exercise Classification and Counting from Video Frames
- 结合关节角度与坐标数据,提升模型对视角和体型变化的适应性。
- 在30帧序列上训练,捕捉动作时序特征,测试准确率达99%以上。
- 可部署于网页端,自动识别动作并计数,适合开发者和健身应用研究者。
本文提出一种基于双向长短期记忆网络(BiLSTM)的实时健身动作分类方法。现有方法多依赖合成数据、对用户与摄像头变化敏感的原始坐标输入,且未能充分建模动作的时序依赖关系,导致实际场景中泛化能力差。为解决此问题,模型同时使用关节角度与三维坐标(x, y, z),增强对视角、位置和体型差异的鲁棒性。通过在30帧序列上训练,模型能有效捕捉动作的动态演变模式。研究整合了来自InfiniteRep的合成数据与Kaggle等来源的真实视频,构建包含深蹲、俯卧撑、肩推和弯举四种常见动作的数据集。模型在该数据集上测试准确率超过99%,并在两个独立测试集上验证其泛化性能。结果表明,本方法优于已有文献中的模型。系统已集成至网页应用,支持无手动选择的实时动作识别与重复计数。代码与数据集见GitHub:https://github.com/RiccardoRiccio/Fitness-AI-Trainer-With-Automatic-Exercise-Recognition-and-Counting。
原文摘要 · Abstract (English)
This paper introduces a novel method for real-time exercise classification using a Bidirectional Long Short-Term Memory (BiLSTM) neural network. Existing exercise recognition approaches often rely on synthetic datasets, raw coordinate inputs sensitive to user and camera variations, and fail to fully exploit the temporal dependencies in exercise movements. These issues limit their generalizability and robustness in real-world conditions, where lighting, camera angles, and user body types vary. To address these challenges, we propose a BiLSTM-based model that leverages invariant features, such as joint angles, alongside raw coordinates. By using both angles and (x, y, z) coordinates, the model adapts to changes in perspective, user positioning, and body differences, improving generalization. Training on 30-frame sequences enables the BiLSTM to capture the temporal context of exercises and recognize patterns evolving over time. We compiled a dataset combining synthetic data from the InfiniteRep dataset and real-world videos from Kaggle and other sources. This dataset includes four common exercises: squat, push-up, shoulder press, and bicep curl. The model was trained and validated on these diverse datasets, achieving an accuracy of over 99% on the test set. To assess generalizability, the model was tested on 2 separate test sets representative of typical usage conditions. Comparisons with the previous approach from the literature are present in the result section showing that the proposed model is the best-performing one. The classifier is integrated into a web application providing real-time exercise classification and repetition counting without manual exercise selection. Demo and datasets are available at the following GitHub Repository: https://github.com/RiccardoRiccio/Fitness-AI-Trainer-With-Automatic-Exercise-Recognition-and-Counting.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。