arXiv:2606.00461cs.CVeess.SP2026-06

用时间域数据直接检测震颤,无需专家设计的频域特征。

An explainable hierarchical self attention-based approach for tremor detection in the time domain

论文配图:An explainable hierarchical self attention-based approach for tremor detection in the time domain
图 1 · 摘自论文原文
  • 分两阶段:先用CNN-LSTM提取短时片段特征,再用视觉变压器建模长期动态
  • 在9个身体部位上平均F1达0.765,部分达到0.947
  • 通过注意力权重和Grad-CAM实现可解释性,识别震颤的时间与部位模式

震颤是帕金森病和特发性震颤等运动障碍的常见表现,传统诊断依赖临床医生评估。现有自动化方法多基于频域特征,需依赖临床知识。本文提出一种可解释的两级分层框架,在时间域直接从3D运动学标记时序数据中学习震颤模式,覆盖整个诱发震颤的试验过程。框架首先利用深度卷积与长短期记忆网络,从试验中不重叠的短时段运动时序数据中提取特征;随后由视觉变压器对这些片段特征的长期时间动态进行建模,完成试验(会话)级分类。在9个身体部位上评估,F1得分介于0.594至0.947之间(平均0.765),虽低于频域最先进水平(0.909),但显著减少预处理需求。通过注意力权重与基于梯度的类激活图(Grad-CAM),识别出各身体部位的时间域震颤特征。该概念验证表明,数据驱动的时间域建模在解剖多样部位上检测震颤具有可行性,同时降低对专家设计频域特征的依赖,并提供事后可解释性。

原文摘要 · Abstract (English)

Tremor is a common movement disorder associated with conditions like Parkinson's disease and Essential tremor, traditionally diagnosed through expert clinician assessment. Current automated detection methods rely on frequency-domain features informed by clinical expertise. In this work, we present an explainable, two-stage hierarchical framework for tremor detection in the time domain that learns tremor patterns directly from 3D kinematic marker time-series data across entire tremor-provoking trials. Our framework combined a deep convolutional and long short-term memory network to learn tremor representations from short, discrete, non-overlapping time segments of kinematic time series data from trials, which are then processed by a vision transformer that models their long-term temporal dynamics of time segment features for trial (session) level classification. Evaluated across nine body parts, the framework achieved F1-scores of 0.594 - 0.947 depending on body parts (average: 0.765), falling short of the frequency-domain state-of-the-art performance (0.909) while requiring minimal preprocessing. Attention weights and gradient-based class activation maps (Grad-CAM) identified time-domain features of tremor across body parts. This proof of concept demonstrated the feasibility of data-driven time-domain modeling for tremor detection across anatomically diverse body parts, while reducing reliance on expert-engineered spectral features and providing posthoc interpretability of temporal and anatomical patterns of tremor.

震颤检测时间域分析可解释性运动障碍

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。