arXiv:2412.20733cs.CVcs.AI2024-12被引 16

用隐私保护技术将康复视频转为可分析数据,辅助膝关节康复监测。

Towards nation-wide analytical healthcare infrastructures: A privacy-preserving augmented knee rehabilitation case study

  • 通过姿态估计将手机拍摄的康复视频转为带角度数据的时间序列。
  • 能准确识别91.67%至100%的训练动作,支持多视角分析。
  • 算法开源透明,适合医疗系统部署,保障患者隐私与数据自主。

本文致力于构建未来可扩展的隐私保护型医疗大数据分析平台,能够处理患者上传或实时流式传输的时序数据或视频。实验基于真实膝关节康复视频数据集,涵盖从简单个性化到复杂挑战性动作的多种训练场景。利用Google MediaPipe进行姿态估计,将手机视频转化为带隐私保护的诊断时序数据;开发的原型算法可在视频中叠加骨架图,并实时生成以CSV格式输出的膝角变化时间序列。用户可通过前后视图视频,结合预设膝角参数,直观观察如过度屈膝、膝部不稳等潜在问题。针对康复依从性与训练次数量化,自适应算法在多视角下对所有动作的识别准确率达91.67%至100%。算法设计透明,支持可解释人工智能,推动未来非厂商锁定、开源、本地化部署的国家医疗系统应用。

原文摘要 · Abstract (English)

The purpose of this paper is to contribute towards the near-future privacy-preserving big data analytical healthcare platforms, capable of processing streamed or uploaded timeseries data or videos from patients. The experimental work includes a real-life knee rehabilitation video dataset capturing a set of exercises from simple and personalised to more general and challenging movements aimed for returning to sport. To convert video from mobile into privacy-preserving diagnostic timeseries data, we employed Google MediaPipe pose estimation. The developed proof-of-concept algorithms can augment knee exercise videos by overlaying the patient with stick figure elements while updating generated timeseries plot with knee angle estimation streamed as CSV file format. For patients and physiotherapists, video with side-to-side timeseries visually indicating potential issues such as excessive knee flexion or unstable knee movements or stick figure overlay errors is possible by setting a-priori knee-angle parameters. To address adherence to rehabilitation programme and quantify exercise sets and repetitions, our adaptive algorithm can correctly identify (91.67%-100%) of all exercises from side- and front-view videos. Transparent algorithm design for adaptive visual analysis of various knee exercise patterns contributes towards the interpretable AI and will inform near-future privacy-preserving, non-vendor locking, open-source developments for both end-user computing devices and as on-premises non-proprietary cloud platforms that can be deployed within the national healthcare system.

医疗AI隐私保护康复分析姿态估计

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。