用生成模型模拟帕金森步态,解决临床数据少难题
GAITGen: Disentangled Motion-Pathology Impaired Gait Generative Model -- Bringing Motion Generation to the Clinical Domain
- 分离运动与病理特征,按严重程度生成真实步态
- 在新数据集上生成质量优于现有方法,还原关键病理特征
- 适合临床研究、模型训练,提升步态评估精度
步态分析对帕金森病等运动障碍的诊断与监测至关重要。尽管计算机视觉模型在客观评估帕金森步态方面展现出潜力,但受限于临床数据稀缺及大规模高质量标注数据难以获取,导致模型准确率低且存在偏见风险。为此,我们提出GAITGen,一种可按指定病理严重程度生成真实步态序列的新框架。GAITGen采用条件残差向量量化变分自编码器,学习运动动态与病理特异性因素的解耦表示,并结合掩码与残差变换器实现条件序列生成。该模型能在不同严重程度下生成逼真且多样的步态序列,丰富数据集并支持大规模模型训练。在新构建的PD-GaM(真实)数据集上的实验表明,GAITGen在重建保真度和生成质量上均优于适配的先进模型,能准确捕捉关键病理特异性步态特征。临床用户研究表明生成序列具有真实感与临床相关性。此外,将生成数据用于下游任务可提升帕金森步态严重程度估计性能,凸显其在推进临床步态分析中的潜力。
原文摘要 · Abstract (English)
Gait analysis is crucial for the diagnosis and monitoring of movement disorders like Parkinson's Disease. While computer vision models have shown potential for objectively evaluating parkinsonian gait, their effectiveness is limited by scarce clinical datasets and the challenge of collecting large and well-labelled data, impacting model accuracy and risk of bias. To address these gaps, we propose GAITGen, a novel framework that generates realistic gait sequences conditioned on specified pathology severity levels. GAITGen employs a Conditional Residual Vector Quantized Variational Autoencoder to learn disentangled representations of motion dynamics and pathology-specific factors, coupled with Mask and Residual Transformers for conditioned sequence generation. GAITGen generates realistic, diverse gait sequences across severity levels, enriching datasets and enabling large-scale model training in parkinsonian gait analysis. Experiments on our new PD-GaM (real) dataset demonstrate that GAITGen outperforms adapted state-of-the-art models in both reconstruction fidelity and generation quality, accurately capturing critical pathology-specific gait features. A clinical user study confirms the realism and clinical relevance of our generated sequences. Moreover, incorporating GAITGen-generated data into downstream tasks improves parkinsonian gait severity estimation, highlighting its potential for advancing clinical gait analysis.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。