arXiv:2601.12610eess.SYcs.LG2026-01被引 1

HERMES开源框架实现多模态生理数据实时处理,助力智能医疗闭环应用。

HERMES: A Unified Open-Source Framework for Realtime Multimodal Physiological Sensing, Edge AI, and Intervention in Closed-Loop Smart Healthcare Applications

  • 基于Python构建边缘计算框架,支持多源异构传感器同步采集
  • 在4台主机上协同处理18种可穿戴与非可穿戴模态数据,实现低延迟推理
  • 适用于实验室与真实生活场景,适合智能假肢等闭环医疗系统开发

智能辅助技术正日益成为残障人士及老年人功能衰退的日常关键支持。长期研究、高质量数据集构建、日常生活活动中的实时监测以及智能干预设备,均面临可靠高通量多模态感知与处理的迫切需求。以往受限于分布式传感器的流式数据传输、封闭源代码环境及实时闭环AI方法研究稀缺,相关应用发展受阻。为加速临床落地,我们推出HERMES——首个开源高性能Python框架,可在通用计算设备上实现边缘端连续多模态感知与AI处理。该框架支持同步数据采集与用户自定义PyTorch模型的实时流式推理,适用于固定实验室与自由生活场景,兼容商用与定制化传感器。它是首个贯通跨学科实际实施策略的综合性方法,指导下游AI模型开发。在闭环智能假肢应用中,验证了从生成约束与权衡中发展合适AI模型的全流程。通过4个协同主机共同采集18种可穿戴与非可穿戴模态数据,证明了其在智能医疗领域中的性能与适用性。

原文摘要 · Abstract (English)

Intelligent assistive technologies are increasingly recognized as critical daily-use enablers for people with disabilities and age-related functional decline. Longitudinal studies, curation of quality datasets, live monitoring in activities of daily living, and intelligent intervention devices, share the largely unsolved need in reliable high-throughput multimodal sensing and processing. Streaming large heterogeneous data from distributed sensors, historically closed-source environments, and limited prior works on realtime closed-loop AI methodologies, inhibit such applications. To accelerate the emergence of clinical deployments, we deliver HERMES - an open-source high-performance Python framework for continuous multimodal sensing and AI processing at the edge. It enables synchronized data collection, and realtime streaming inference with user PyTorch models, on commodity computing devices. HERMES is applicable to fixed-lab and free-living environments, of distributed commercial and custom sensors. It is the first work to offer a holistic methodology that bridges cross-disciplinary gaps in real-world implementation strategies, and guides downstream AI model development. Its application on the closed-loop intelligent prosthesis use case illustrates the process of suitable AI model development from the generated constraints and trade-offs. Validation on the use case, with 4 synchronized hosts cooperatively capturing 18 wearable and off-body modalities, demonstrates performance and relevance of HERMES to the trajectory of the intelligent healthcare domain.

智能医疗边缘计算多模态传感闭环系统

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。