用不确定性量化提升可穿戴设备心律失常与血压预测的可信度
Uncertainty quantification with approximate variational learning for wearable photoplethysmography prediction tasks
- 采用蒙特卡洛丢弃与改进变分在线牛顿法评估模型置信度
- 超参数选择显著影响预测性能与不确定性质量,需权衡精度与校准
- 不同类别间不确定性差异大,适合医疗健康领域模型可靠性研究
光电容积脉搏波(PPG)信号可非侵入式反映血容量变化,用于心房颤动(AF)检测和血压(BP)预测。深度网络虽能处理可穿戴设备的大规模数据,但缺乏可解释性且易过拟合,导致在未见数据上表现差,增加误诊风险。本文采用两种可扩展的不确定性量化技术:蒙特卡洛丢弃和近期提出的改进变分在线牛顿法,评估基于原始PPG时间序列进行AF分类与BP回归模型的可信度。结果表明,超参数选择对模型预测性能及不确定性质量有显著影响。例如,模型参数采样随机性决定了总不确定性中固有不确定性(aleatoric)的比例,并随所选不确定性量化方法和表达形式不同,对预测性能和校准质量产生差异化影响。不同预测类别间的不确定性质量存在显著差异,凸显了需建立局部自适应校准评估协议的重要性。本研究建议应仔细调优超参数以平衡预测性能与校准质量,且最优配置可能依赖于具体的不确定性表达方式。
原文摘要 · Abstract (English)
Photoplethysmography (PPG) signals encode information about relative changes in blood volume that can be used to assess various aspects of cardiac health non-invasively, e.g.\ to detect atrial fibrillation (AF) or predict blood pressure (BP). Deep networks are well-equipped to handle the large quantities of data acquired from wearable measurement devices. However, they lack interpretability and are prone to overfitting, leaving considerable risk for poor performance on unseen data and misdiagnosis. Here, we describe the use of two scalable uncertainty quantification techniques: Monte Carlo Dropout and the recently proposed Improved Variational Online Newton. These techniques are used to assess the trustworthiness of models trained to perform AF classification and BP regression from raw PPG time series. We find that the choice of hyperparameters has a considerable effect on the predictive performance of the models and on the quality and composition of predicted uncertainties. E.g. the stochasticity of the model parameter sampling determines the proportion of the total uncertainty that is aleatoric, and has varying effects on predictive performance and calibration quality dependent on the chosen uncertainty quantification technique and the chosen expression of uncertainty. We find significant discrepancy in the quality of uncertainties over the predicted classes, emphasising the need for a thorough evaluation protocol that assesses local and adaptive calibration. This work suggests that the choice of hyperparameters must be carefully tuned to balance predictive performance and calibration quality, and that the optimal parameterisation may vary depending on the chosen expression of uncertainty.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。