用多阶段深度学习与物联网实时识别病人关键动作,准确率超94%。
IoT-Based Real-Time Medical-Related Human Activity Recognition Using Skeletons and Multi-Stage Deep Learning for Healthcare
- 分阶段用EfficientNet和ConvLSTM提取骨骼序列的空间与时序特征
- 跨人体评估准确率达94.85%,跨视角达96.45%,在多个数据集上表现优异
- 基于树莓派与短信服务实现低延迟报警,适合居家健康监护场景
物联网与移动技术显著推动了医疗健康领域的发展,实现了对患者的实时监测与诊断。识别医疗相关人体行为(MRHA)对健康系统至关重要,尤其在识别影响患者安全的关键动作方面。然而,人体运动识别(HMR)仍面临计算开销大、精度低和适应性差等问题。尽管已有研究将HMR与物联网结合用于实时医疗应用,但针对MRHA的专门研究仍有限。本文提出一种新型多阶段深度学习框架,用于基于骨架序列的MRHA检测。该方法使用EfficientNet通过七个Mobile Inverted Bottleneck Convolutions(MBConv)块提取优化的空间特征,再经ConvLSTM捕捉时空模式,最后通过全局平均池化、全连接层与丢弃层进行分类。模型在NTU RGB+D 120和HMDB51数据集上评估,涵盖打喷嚏、跌倒、行走、就坐等行为。跨主体测试准确率为94.85%,跨视角测试达96.45%,在HMDB51上为89.00%。系统还集成树莓派与GSM模块,通过Twilio短信服务实现实时告警,具备可扩展性和高效性,有效连接了HMR与物联网,提升了患者监护能力,改善医疗效果并降低成本。
原文摘要 · Abstract (English)
The Internet of Things (IoT) and mobile technology have significantly transformed healthcare by enabling real-time monitoring and diagnosis of patients. Recognizing medical-related human activities (MRHA) is pivotal for healthcare systems, particularly for identifying actions that are critical to patient well-being. However, challenges such as high computational demands, low accuracy, and limited adaptability persist in Human Motion Recognition (HMR). While some studies have integrated HMR with IoT for real-time healthcare applications, limited research has focused on recognizing MRHA as essential for effective patient monitoring. This study proposes a novel HMR method for MRHA detection, leveraging multi-stage deep learning techniques integrated with IoT. The approach employs EfficientNet to extract optimized spatial features from skeleton frame sequences using seven Mobile Inverted Bottleneck Convolutions (MBConv) blocks, followed by ConvLSTM to capture spatio-temporal patterns. A classification module with global average pooling, a fully connected layer, and a dropout layer generates the final predictions. The model is evaluated on the NTU RGB+D 120 and HMDB51 datasets, focusing on MRHA, such as sneezing, falling, walking, sitting, etc. It achieves 94.85% accuracy for cross-subject evaluations and 96.45% for cross-view evaluations on NTU RGB+D 120, along with 89.00% accuracy on HMDB51. Additionally, the system integrates IoT capabilities using a Raspberry Pi and GSM module, delivering real-time alerts via Twilios SMS service to caregivers and patients. This scalable and efficient solution bridges the gap between HMR and IoT, advancing patient monitoring, improving healthcare outcomes, and reducing costs.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。