arXiv:2410.19575stat.MLcs.LG2024-10被引 1

医疗诊断模型在人群分布变化时易失效,本文提出通过引入协变量提升鲁棒性。

Considerations for Distribution Shift Robustness of Diagnostic Models in Healthcare

  • 识别医疗数据中疾病导致生物标志物的因果结构,避免学习不稳定的捷径依赖
  • 理论证明忽略协变量或常用不变学习方法无法保证分布外鲁棒性
  • 实验验证协变量加入可显著提升模型在不同人群上的泛化能力,适合临床部署

本文研究医疗诊断模型在分布偏移下的鲁棒性问题,其中预测目标 $Y$(如疾病存在)在因果上先于观测值 $X$(如生物标志物)。当训练数据来自特定人群而部署于不同人群时,分布偏移可能发生。当前常见做法是仅基于 $X$ 预测 $Y$,但模型可能学习到 $X$ 与 $Y$ 间不稳定的混淆依赖(即捷径),导致泛化失败。本文揭示医疗场景中常见的数据生成机制,并应用因果推断理论,证明忽略协变量或使用常见不变学习方法通常无法获得鲁棒预测;而合理引入某些协变量则可实现鲁棒性。通过大量模拟实验验证不同方法在多种数据生成过程下的表现,并在公开的 PTB-XL 心电图数据集上分析模型性能,结果表明协变量纳入能显著提升分布外稳定性。

原文摘要 · Abstract (English)

We consider robustness to distribution shifts in the context of diagnostic models in healthcare, where the prediction target $Y$, e.g., the presence of a disease, is causally upstream of the observations $X$, e.g., a biomarker. Distribution shifts may occur, for instance, when the training data is collected in a domain with patients having particular demographic characteristics while the model is deployed on patients from a different demographic group. In the domain of applied ML for health, it is common to predict $Y$ from $X$ without considering further information about the patient. However, beyond the direct influence of the disease $Y$ on biomarker $X$, a predictive model may learn to exploit confounding dependencies (or shortcuts) between $X$ and $Y$ that are unstable under certain distribution shifts. In this work, we highlight a data generating mechanism common to healthcare settings and discuss how recent theoretical results from the causality literature can be applied to build robust predictive models. We theoretically show why ignoring covariates as well as common invariant learning approaches will in general not yield robust predictors in the studied setting, while including certain covariates into the prediction model will. In an extensive simulation study, we showcase the robustness (or lack thereof) of different predictors under various data generating processes. Lastly, we analyze the performance of the different approaches using the PTB-XL dataset, a public dataset of annotated ECG recordings.

医疗诊断分布外泛化因果推断鲁棒性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。