用手指敲击动作结合注意力增强模型,实现帕金森病五级严重程度精准识别。
Multi Class Parkinson Disease Detection Based on Finger Tapping Using Attention Enhanced CNN BiLSTM
- 融合手工特征与注意力增强的CNN-BiLSTM混合模型,捕捉运动时空特征。
- 在五类严重程度分类中表现优异,准确率显著优于传统方法。
- 适合临床辅助评估帕金森进展,非侵入式且可推广至远程监测。
帕金森病(PD)严重程度的准确评估对临床管理与干预策略制定至关重要。尽管已有多种基于手势的PD识别系统,包括利用手指敲击任务评估症状的方法,但其性能仍不理想。本研究提出一种基于手指敲击的多类别帕金森病检测系统,采用注意力增强的CNN-BiLSTM框架,并结合手工特征提取与深度学习技术。首先,利用现有手指敲击视频数据集,通过公式提取腕部与手部运动的时间、频率和振幅特征。这些手工特征随后输入注意力增强的CNN-BiLSTM模型,该模型融合卷积神经网络(CNN)、双向长短期记忆网络(BiLSTM)与注意力机制,将运动信号分为五类严重程度。特征先经由一维卷积与最大池化层捕获局部空间依赖性,再通过双层BiLSTM建模时间动态变化;注意力机制聚焦于最具信息量的时序片段,由第二层BiLSTM进一步优化。最终,CNN提取特征与注意力强化的BiLSTM输出拼接,经全连接与丢弃层后,由软分类器预测帕金森病严重程度。实验表明,该模型在五类分级任务中表现突出,验证了时空表征与注意力机制融合的有效性。该方法为临床提供了一种有前景的非侵入式工具,可用于监测帕金森病进展并支持治疗决策。
原文摘要 · Abstract (English)
Accurate evaluation of Parkinsons disease (PD) severity is essential for effective clinical management and intervention development. Despite the proposal of several gesture based PD recognition systems, including those using the finger tapping task to assess Parkinsonian symptoms, their performance remains unsatisfactory. In this study, we present a multi class PD detection system based on finger-tapping, using an attention-enhanced CNN BiLSTM framework combined with handcrafted feature extraction and deep learning techniques. In the procedure, we used an existing dataset of finger tapping videos to extract temporal, frequency, and amplitude-based features from wrist and hand movements using their formulas. These handcrafted features were then processed through our attention enhanced CNN BiLSTM model, a hybrid deep learning framework that integrates CNN, BiLSTM, and attention mechanisms to classify PD severity into multiple levels. The features first pass through a Conv1D MaxPooling block to capture local spatial dependencies, followed by processing through a BiLSTM layer to model the temporal dynamics of the motion. An attention mechanism is applied to emphasize the most informative temporal features, which are then refined by a second BiLSTM layer. The CNN derived features and attention enhanced BiLSTM outputs are concatenated, followed by dense and dropout layers, before being passed through a softmax classifier to predict the PD severity level. Our model demonstrated strong performance in distinguishing between the five severity classes, showcasing the effectiveness of combining spatial temporal representations with attention mechanisms for automated PD severity detection. This approach offers a promising non invasive tool to assist clinicians in monitoring PD progression and making informed treatment decisions.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。