GBDT在医疗表格数据分类中表现优异,兼顾高精度与低计算成本。
Gradient Boosting Decision Trees on Medical Diagnosis over Tabular Data
- 采用XGBoost、CatBoost、LightGBM等梯度提升树方法处理医疗表格数据
- 在多个基准数据集上超越传统机器学习和深度学习模型,平均排名最高
- 相比深度模型计算开销更低,适合实际医疗诊断场景部署
医疗诊断是医学领域的重要任务,准确的分类结果直接关系患者生命安全。尽管已有支持向量机(SVM)、逻辑回归等传统机器学习方法,以及TabNet、TabTransformer等先进的表格式深度学习模型应用于医疗表格数据,但近年来集成方法因性能优越、计算成本低、优化简单而备受关注。本研究系统评估了梯度提升决策树(GBDT)算法在医疗分类任务中的表现,重点比较了XGBoost、CatBoost和LightGBM。实验表明,GBDT方法在多个基准医疗表格数据集上均优于传统机器学习与深度神经网络模型,平均排名领先;同时其计算资源需求显著低于深度学习模型,兼具高性能与低复杂度,是医疗诊断任务的理想选择。
原文摘要 · Abstract (English)
Medical diagnosis is a crucial task in the medical field, in terms of providing accurate classification and respective treatments. Having near-precise decisions based on correct diagnosis can affect a patient's life itself, and may extremely result in a catastrophe if not classified correctly. Several traditional machine learning (ML), such as support vector machines (SVMs) and logistic regression, and state-of-the-art tabular deep learning (DL) methods, including TabNet and TabTransformer, have been proposed and used over tabular medical datasets. Additionally, due to the superior performances, lower computational costs, and easier optimization over different tasks, ensemble methods have been used in the field more recently. They offer a powerful alternative in terms of providing successful medical decision-making processes in several diagnosis tasks. In this study, we investigated the benefits of ensemble methods, especially the Gradient Boosting Decision Tree (GBDT) algorithms in medical classification tasks over tabular data, focusing on XGBoost, CatBoost, and LightGBM. The experiments demonstrate that GBDT methods outperform traditional ML and deep neural network architectures and have the highest average rank over several benchmark tabular medical diagnosis datasets. Furthermore, they require much less computational power compared to DL models, creating the optimal methodology in terms of high performance and lower complexity.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。