用骨骼关节动态建模实现高效精准跌倒检测,兼顾隐私与性能。
Modeling Human Skeleton Joint Dynamics for Fall Detection
- 基于图卷积网络捕捉关节间时空依赖关系
- 模型更小却在NTU数据集上达到顶尖准确率
- 适合需要隐私保护的养老场景应用
人口老龄化加剧催生了对更好照护系统的需求。跌倒对老年人是常见且严重的问题,可能导致长期健康损害。从视频流中进行跌倒检测因隐私问题难以实际应用。现有方法尝试通过低分辨率摄像头或视频加密解决,但无法完全保障隐私。人体关键点如骨骼关节能有效反映运动动态和姿态变化,对跌倒检测至关重要。尽管骨骼关节已被用于特征提取,但现有图像识别模型忽略帧间关节依赖性,影响动作分类效果。此外,现有模型参数量过大,或仅在小规模数据集上评估,活动类别有限。本文提出一种高效的图卷积网络模型,利用骨骼关节的时空依赖性和动态特性,实现精准跌倒检测。该方法具备动态表征能力,能捕捉关节的鲁棒并发时空特征。我们在三个大规模数据集上进行了广泛实验。相比多数现有方法,本模型规模显著减小,但在大规模NTU数据集上仍达到当前最优性能。
原文摘要 · Abstract (English)
The increasing pace of population aging calls for better care and support systems. Falling is a frequent and critical problem for elderly people causing serious long-term health issues. Fall detection from video streams is not an attractive option for real-life applications due to privacy issues. Existing methods try to resolve this issue by using very low-resolution cameras or video encryption. However, privacy cannot be ensured completely with such approaches. Key points on the body, such as skeleton joints, can convey significant information about motion dynamics and successive posture changes which are crucial for fall detection. Skeleton joints have been explored for feature extraction but with image recognition models that ignore joint dependency across frames which is important for the classification of actions. Moreover, existing models are over-parameterized or evaluated on small datasets with very few activity classes. We propose an efficient graph convolution network model that exploits spatio-temporal joint dependencies and dynamics of human skeleton joints for accurate fall detection. Our method leverages dynamic representation with robust concurrent spatio-temporal characteristics of skeleton joints. We performed extensive experiments on three large-scale datasets. With a significantly smaller model size than most existing methods, our proposed method achieves state-of-the-art results on the large scale NTU datasets.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。