用AI自动判断健身动作是否达标,规则透明可解释。
KD-Judge: A Knowledge-Driven Automated Judge Framework for Functional Fitness Movements on Edge Devices
- 将规则手册转为机器可读结构,基于动作姿态进行推理判断
- 在CFRep数据集上实现毫秒级响应,实时因子低于1
- 适合边缘设备部署,提升低算力场景下的判断效率
功能性健身动作广泛应用于训练、竞赛和健康项目中,但重复动作的标准执行因主观判断、时间限制和规则更新而困难。现有AI方法多依赖学习评分或参考对比,缺乏显式规则驱动机制,导致判断不透明且难以确定性验证。为此,我们提出KD-Judge,一种知识驱动的自动化裁判框架。通过LLM增强的检索生成与思维链规则构建流程,将非结构化规则书转化为可执行的机器表示;再由确定性规则系统结合姿态引导的运动学推理,评估动作有效性和时间边界。为提升边缘设备(包括高性能桌面及资源受限的Jetson AGX Xavier)效率,引入可选的双策略缓存机制,减少冗余计算。实验表明,规则构建可靠,动作判定准确,在CFRep数据集上实现快于实时的运行(实时因子RTF < 1)。启用缓存后,预录视频和实时流场景下分别达到3.36倍和15.91倍加速,证明该系统具备透明、高效、可扩展的规则化动作分析能力,可实际辅助人工裁判。
原文摘要 · Abstract (English)
Functional fitness movements are widely used in training, competition, and health-oriented exercise programs, yet consistently enforcing repetition (rep) standards remains challenging due to subjective human judgment, time constraints, and evolving rules. Existing AI-based approaches mainly rely on learned scoring or reference-based comparisons and lack explicit rule-based approaches, limiting transparency and deterministic rep-level validation. To address these limitations, we propose KD-Judge, a novel knowledge-driven automated judging framework for functional fitness movements. It converts unstructured rulebook standards into executable, machine-readable representations using an LLM-based retrieval-augmented generation and chain-of-thought rule-structuring pipeline. The structured rules are then incorporated by a deterministic rule-based judging system with pose-guided kinematic reasoning to assess rep validity and temporal boundaries. To improve efficiency on edge devices, including a high-performance desktop and the resource-constrained Jetson AGX Xavier, we introduce a dual strategy caching mechanism that can be selectively applied to reduce redundant and unnecessary computation. Experiments demonstrate reliable rule-structuring performance and accurate rep-level assessment, with judgment evaluation conducted on the CFRep dataset, achieving faster-than-real-time execution (real-time factor (RTF) < 1). When the proposed caching strategy is enabled, the system achieves up to 3.36x and 15.91x speedups on resource-constrained edge device compared to the non-caching baseline for pre-recorded and live-streaming scenarios, respectively. These results show that KD-Judge enables transparent, efficient, and scalable rule-grounded rep-level analysis that can complement human judging in practice.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。