arXiv:2502.19766cs.CV2025-02被引 1

用关键点检测与时间分割,自动分析中风康复训练视频。

Automatic Temporal Segmentation for Post-Stroke Rehabilitation: A Keypoint Detection and Temporal Segmentation Approach for Small Datasets

  • 通过2D关键点+1D时序分割,自动识别康复动作片段。
  • 仅需少量真实数据即可实现精准动作标注,适应患者差异大、数据少的场景。
  • 适合临床康复评估、物理治疗自动化系统研发人员使用。

中风康复对老年患者至关重要,75%的中风病例发生在65岁以上人群。当前评估依赖治疗师主观判断,存在不一致、耗时等问题。本研究针对日常桌面物体互动任务,提出一种结合运动生物力学的自动时间分割框架。该方法分两步:先进行2D关键点检测以追踪患者动作,再通过1D时序分割分析动作随时间变化模式。此双阶段设计可在仅有少量真实数据的情况下实现稳定标注,有效应对患者动作差异大、数据稀缺的挑战,为物理治疗场景提供快速、准确的自动化评估支持。

原文摘要 · Abstract (English)

Rehabilitation is essential and critical for post-stroke patients, addressing both physical and cognitive aspects. Stroke predominantly affects older adults, with 75% of cases occurring in individuals aged 65 and older, underscoring the urgent need for tailored rehabilitation strategies in aging populations. Despite the critical role therapists play in evaluating rehabilitation progress and ensuring the effectiveness of treatment, current assessment methods can often be subjective, inconsistent, and time-consuming, leading to delays in adjusting therapy protocols. This study aims to address these challenges by providing a solution for consistent and timely analysis. Specifically, we perform temporal segmentation of video recordings to capture detailed activities during stroke patients' rehabilitation. The main application scenario motivating this study is the clinical assessment of daily tabletop object interactions, which are crucial for post-stroke physical rehabilitation. To achieve this, we present a framework that leverages the biomechanics of movement during therapy sessions. Our solution divides the process into two main tasks: 2D keypoint detection to track patients' physical movements, and 1D time-series temporal segmentation to analyze these movements over time. This dual approach enables automated labeling with only a limited set of real-world data, addressing the challenges of variability in patient movements and limited dataset availability. By tackling these issues, our method shows strong potential for practical deployment in physical therapy settings, enhancing the speed and accuracy of rehabilitation assessments.

康复评估动作分割关键点检测小样本学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。