动态图与状态空间模型结合,提升步态障碍识别精度与效率
DynSTG-Mamba: Dynamic Spatio-Temporal Graph Mamba with Cross-Graph Knowledge Distillation for Gait Disorders Recognition
- 用动态图结构自适应调整关节间连接,捕捉步态时序变化
- 在三个数据集上准确率、F1值均优于现有方法
- 轻量化设计适合临床部署,特别适合资源受限场景
步态障碍识别对运动障碍的早期诊断和监测至关重要。现有方法如时空图卷积网络(ST-GCN)常面临高内存需求,难以捕捉复杂的时空依赖关系,限制了其在临床中的应用。为此,我们提出DynSTG-Mamba:一种融合动态时空图神经网络(DF-STGNN)与时空图Mamba(STG-Mamba)的新框架。DF-STGNN引入动态时空滤波器,自适应调整骨骼关节间的空间连接及不同运动阶段的时序交互,通过考虑骨骼步态数据的层级性与动态特性,提升特征传播效果。同时,STG-Mamba是专为骨骼运动数据设计的Mamba扩展,实现状态连续传播,有效捕捉长期依赖,且计算复杂度更低。为进一步降低参数量与计算成本并保持性能一致性,我们提出跨图关系知识蒸馏机制,通过共享内存对齐教师模型(大架构)与学生模型(小架构)的关系信息,精确保留关节间互动与运动模式。我们在KOA-NM、PD-WALK和ATAXIA数据集上验证了该方法,结果表明其在准确率、F1分数和召回率上均超越当前最优方法,展现出高效性与鲁棒性,为自动化步态分析与运动障碍评估提供了一种轻量但高精度的解决方案。
原文摘要 · Abstract (English)
Gait disorder recognition plays a crucial role in the early diagnosis and monitoring of movement disorders. Existing approaches, including spatio-temporal graph convolutional networks (ST-GCNs), often face high memory demands and struggle to capture complex spatio-temporal dependencies, limiting their efficiency in clinical applications. To address these challenges, we introduce DynSTG-Mamba (Dynamic Spatio-Temporal Graph Mamba), a novel framework that combines DF-STGNN and STG-Mamba to enhance motion sequence modeling. The DF-STGNN incorporates a dynamic spatio-temporal filter that adaptively adjusts spatial connections between skeletal joints and temporal interactions across different movement phases. This approach ensures better feature propagation through dynamic graph structures by considering the hierarchical nature and dynamics of skeletal gait data. Meanwhile, STG-Mamba, an extension of Mamba adapted for skeletal motion data, ensures a continuous propagation of states, facilitating the capture of long-term dependencies while reducing computational complexity. To reduce the number of model parameters and computational costs while maintaining consistency, we propose Cross-Graph Relational Knowledge Distillation, a novel knowledge transfer mechanism that aligns relational information between teacher (large architecture) and student models (small architecture) while using shared memory. This ensures that the interactions and movement patterns of the joints are accurately preserved in the motion sequences. We validate our DynSTG-Mamba on KOA-NM, PD-WALK, and ATAXIA datasets, where it outperforms state-of-the-art approaches by achieving in terms of Accuracy, F1-score, and Recall. Our results highlight the efficiency and robustness of our approach, offering a lightweight yet highly accurate solution for automated gait analysis and movement disorder assessment.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。