arXiv:2602.20442cs.LGcs.AI2026-02

提出新方法修复电子病历中难以识别的缺失数据,提升医疗预测准确性。

Imputation of Unknown Missingness in Sparse Electronic Health Records

  • 用Transformer构建自适应阈值去噪网络,识别并恢复未知缺失
  • 在真实病历数据上比现有方法更准确恢复医疗编码
  • 显著提升医院再入院预测等下游任务性能,适合医疗数据建模者

机器学习在医学领域前景广阔,电子健康记录(EHR)是主要数据来源。然而,由于数据收集与共享的挑战,EHR常呈现稀疏性且包含大量缺失数据。现有补全方法多针对已知缺失(如未做检查),但无法处理‘未知未知’——例如诊断码缺失可能意味着未诊断或已诊断未共享。为此,我们提出一种通用去噪算法,用于恢复二值型EHR中的未知缺失值。设计基于Transformer的去噪神经网络,输出通过自适应阈值恢复缺失项。实验表明,该方法在真实EHR数据上比现有补全技术更准确地还原医疗代码,并在下游任务中表现更优。尤其在利用真实数据预测医院再入院时,相比所有基线方法均取得统计显著提升。

原文摘要 · Abstract (English)

Machine learning holds great promise for advancing the field of medicine, with electronic health records (EHRs) serving as a primary data source. However, EHRs are often sparse and contain missing data due to various challenges and limitations in data collection and sharing between healthcare providers. Existing techniques for imputing missing values predominantly focus on known unknowns, such as missing or unavailable values of lab test results; most do not explicitly address situations where it is difficult to distinguish what is missing. For instance, a missing diagnosis code in an EHR could signify either that the patient has not been diagnosed with the condition or that a diagnosis was made, but not shared by a provider. Such situations fall into the paradigm of unknown unknowns. To address this challenge, we develop a general purpose algorithm for denoising data to recover unknown missing values in binary EHRs. We design a transformer-based denoising neural network where the output is thresholded adaptively to recover values in cases where we predict data are missing. Our results demonstrate improved accuracy in denoising medical codes within a real EHR dataset compared to existing imputation approaches and leads to increased performance on downstream tasks using the denoised data. In particular, when applying our method to a real world application, predicting hospital readmission from EHRs, our method achieves statistically significant improvement over all existing baselines.

电子病历数据补全Transformer医疗AI

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。