对比深度学习与传统方法在疾病发病预测中的表现,发现传统方法更稳定可靠。
Comparison of deep learning and conventional methods for disease onset prediction
- 用逻辑回归、梯度提升、ResNet和Transformer比较预测效果
- 11个数据集上传统方法在外部验证中表现更好,尤其在小数据场景
- 深度学习需更大数据才能发挥优势,适合有充足数据的团队
背景:逻辑回归和梯度提升等传统方法因可靠性与可解释性被广泛用于疾病发病预测。深度学习虽能从临床数据中提取复杂模式,但面临数据稀疏和高维挑战。方法:本研究基于北美、欧洲和亚洲11个数据库的观察性数据,比较了逻辑回归、梯度提升、ResNet和Transformer在肺癌、痴呆和双相情感障碍发病预测中的表现,并在各数据源中进行内外部验证。通过AUROC评估区分度,用Eavg评估校准性。结果:在11个数据集中,传统方法整体优于深度学习模型,尤其在外部验证中表现更佳,体现更强可迁移性。学习曲线显示,深度学习模型需显著更大的数据量才能达到传统方法性能水平。校准性方面,传统方法也更优,其中ResNet校准最差。结论:尽管深度学习具备捕捉结构化医疗数据复杂模式的潜力,但在小样本和训练时间受限场景下,传统模型仍具竞争力。研究强调未来需优化深度学习模型以应对医疗数据的稀疏性、高维性和异质性,并探索其潜力新策略。
原文摘要 · Abstract (English)
Background: Conventional prediction methods such as logistic regression and gradient boosting have been widely utilized for disease onset prediction for their reliability and interpretability. Deep learning methods promise enhanced prediction performance by extracting complex patterns from clinical data, but face challenges like data sparsity and high dimensionality. Methods: This study compares conventional and deep learning approaches to predict lung cancer, dementia, and bipolar disorder using observational data from eleven databases from North America, Europe, and Asia. Models were developed using logistic regression, gradient boosting, ResNet, and Transformer, and validated both internally and externally across the data sources. Discrimination performance was assessed using AUROC, and calibration was evaluated using Eavg. Findings: Across 11 datasets, conventional methods generally outperformed deep learning methods in terms of discrimination performance, particularly during external validation, highlighting their better transportability. Learning curves suggest that deep learning models require substantially larger datasets to reach the same performance levels as conventional methods. Calibration performance was also better for conventional methods, with ResNet showing the poorest calibration. Interpretation: Despite the potential of deep learning models to capture complex patterns in structured observational healthcare data, conventional models remain highly competitive for disease onset prediction, especially in scenarios involving smaller datasets and if lengthy training times need to be avoided. The study underscores the need for future research focused on optimizing deep learning models to handle the sparsity, high dimensionality, and heterogeneity inherent in healthcare datasets, and find new strategies to exploit the full capabilities of deep learning methods.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。