在可穿戴心脏贴片上本地推理比无线传输更省电。
On-Device Inference versus Wireless Streaming: Energy-Efficient Multi-Modal Deep Learning for Wearable Cardiovascular Patches
- 用多模态卷积网络直接在设备上融合心电与心音信号分类
- 模型参数量和计算成本降低近1000倍,准确率达97.5%
- 本地推理能耗仅为云端传输的几分之一,适合长期监测
可穿戴心血管传感器贴片有望实现连续无感监测,但其严格的能量、内存和算力限制使得生理信号应在设备端分析还是上传云端处理尚不明确。本文针对一款同步采集心电图(ECG)和心音图(PCG)信号的资源受限贴片,提出一种端到端的多模态卷积神经网络(CNN),采用早期融合策略,在无需手工特征的情况下直接在设备上完成分类。模型在PhysioNet/Computing in Cardiology Challenge 2016数据集上训练验证,浮点版本准确率达到0.975,媲美最佳报告结果;同时参数量和计算开销降低约三个数量级。我们将8位整数版本部署于集成神经处理单元(NPU)的微控制器上,实测推理能耗。同时在典型评估套件上对比蓝牙低能耗(BLE)通信的能耗,覆盖多种数据包大小。结果显示,NPU推理能耗约为CPU的七分之一;对于每秒实际数据量,本地推理比持续传输原始数据节省数倍能源。结果表明,边缘侧始终开启的心血管监测应以本地智能为核心,而非持续传输。
原文摘要 · Abstract (English)
Wearable cardiovascular sensor patches promise continuous, unobtrusive monitoring, but their tight energy, memory, and compute budgets make it unclear whether physiological signals should be analyzed on the device or streamed to the cloud for processing. We study this inference-versus-transmission trade-off for a resource-constrained patch that records synchronized electrocardiogram (ECG) and phonocardiogram (PCG) signals. We propose an end-to-end, multi-modal convolutional neural network (CNN) with early fusion that classifies the two modalities directly on the device, without hand-crafted features. Trained and validated on the PhysioNet/Computing in Cardiology Challenge 2016 dataset, the floating-point model attains an accuracy of 0.975, which is competitive with the best reported results. At the same time, it reduces the parameter count and computational cost by approximately three orders of magnitude. We deploy an 8-bit integer version of the model on a microcontroller with an integrated neural processing unit (NPU) and measure its inference energy. We also benchmark the energy required for Bluetooth Low Energy (BLE) communication on a representative evaluation kit across a range of payload sizes. NPU inference consumes approximately one-seventh of the energy required for CPU inference. For realistic per-second payloads, local inference is also several times more energy efficient than continuous raw-data streaming. These results show that on-device intelligence, rather than constant transmission, is the more energy-efficient basis for always-on wearable cardiovascular monitoring at the edge.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。