arXiv:2601.06704cs.LGcs.AI2026-01

用反证法检验模型是否依赖真实医学线索,避免误判数据巧合。

Beyond Perfect Scores: Proof-by-Contradiction for Trustworthy Machine Learning

  • 通过随机打乱标签构造反例,测试模型鲁棒性。
  • 真实可信模型在打乱标签后准确率显著下降。
  • 用可解释的p值帮助医生理解模型可靠性,适合医疗领域使用。

机器学习在生物医学预测中潜力巨大,但可信度问题阻碍其临床应用。尤其难以判断模型是依赖真实的临床信号,还是受数据中虚假层级相关性的误导。本文提出一种基于随机反证法的可信度测试方法:在潜在结果框架下对标签进行精心置换,训练并测试模型。真正可信的模型在标签置换后应表现不佳;若真实与置换标签下的准确率相近,则表明存在过拟合、捷径学习或数据泄露。我们通过可解释的费舍尔风格p值量化该行为,便于医学专家理解。在多个新型细菌诊断任务上验证了该方法,有效区分了学习真实因果关系的模型与受数据集瑕疵影响的模型。本工作为机器学习与生命科学研究建立严谨信任基础,推动模型向临床应用迈进。

原文摘要 · Abstract (English)

Machine learning (ML) models show strong promise for new biomedical prediction tasks, but concerns about trustworthiness have hindered their clinical adoption. In particular, it is often unclear whether a model relies on true clinical cues or on spurious hierarchical correlations in the data. This paper introduces a simple yet broadly applicable trustworthiness test grounded in stochastic proof-by-contradiction. Instead of just showing high test performance, our approach trains and tests on spurious labels carefully permuted based on a potential outcomes framework. A truly trustworthy model should fail under such label permutation; comparable accuracy across real and permuted labels indicates overfitting, shortcut learning, or data leakage. Our approach quantifies this behavior through interpretable Fisher-style p-values, which are well understood by domain experts across medical and life sciences. We evaluate our approach on multiple new bacterial diagnostics to separate tasks and models learning genuine causal relationships from those driven by dataset artifacts or statistical coincidences. Our work establishes a foundation to build rigor and trust between ML and life-science research communities, moving ML models one step closer to clinical adoption.

可信机器学习医学AI反证法生物信息

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。