首个专为截肢者假肢步态研究设计的多任务视频数据集。
ProGait: A Multi-Purpose Video Dataset and Benchmark for Transfemoral Prosthesis Users
- 构建包含412段视频的多任务数据集,涵盖假肢轮廓与步态特征。
- 在假肢识别与步态分析上,新模型比通用模型性能提升显著。
- 适合康复工程、计算机视觉及假肢适配研究者使用。
假肢在下肢截肢者的临床康复中至关重要,帮助其恢复行动能力并提升生活质量。步态分析是优化假肢设计与安装的关键,直接影响使用者的移动能力和生活品质。基于视觉的机器学习方法为步态分析提供了可扩展且非侵入式的解决方案,但因假肢外观独特、运动模式新颖,导致目标检测与分析困难。本文提出多用途数据集 ProGait,支持视频对象分割、2D人体姿态估计和步态分析(GA)等任务。ProGait 包含412段来自四位膝上截肢者在不同新装假肢行走测试中的视频,精准描绘了截肢者携带假肢时的身体轮廓、姿态与步态模式。同时提供基准任务与微调基线模型,验证该数据集在假肢相关任务中的实用性与性能。对比预训练视觉模型,使用 ProGait 训练的模型展现出更强的泛化能力。代码与数据集已公开于 GitHub 与 Hugging Face。
原文摘要 · Abstract (English)
Prosthetic legs play a pivotal role in clinical rehabilitation, allowing individuals with lower-limb amputations the ability to regain mobility and improve their quality of life. Gait analysis is fundamental for optimizing prosthesis design and alignment, directly impacting the mobility and life quality of individuals with lower-limb amputations. Vision-based machine learning (ML) methods offer a scalable and non-invasive solution to gait analysis, but face challenges in correctly detecting and analyzing prosthesis, due to their unique appearances and new movement patterns. In this paper, we aim to bridge this gap by introducing a multi-purpose dataset, namely ProGait, to support multiple vision tasks including Video Object Segmentation, 2D Human Pose Estimation, and Gait Analysis (GA). ProGait provides 412 video clips from four above-knee amputees when testing multiple newly-fitted prosthetic legs through walking trials, and depicts the presence, contours, poses, and gait patterns of human subjects with transfemoral prosthetic legs. Alongside the dataset itself, we also present benchmark tasks and fine-tuned baseline models to illustrate the practical application and performance of the ProGait dataset. We compared our baseline models against pre-trained vision models, demonstrating improved generalizability when applying the ProGait dataset for prosthesis-specific tasks. Our code is available at https://github.com/pittisl/ProGait and dataset at https://huggingface.co/datasets/ericyxy98/ProGait.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。