AutoML-Med自动优化医疗表格数据的预处理与建模,提升罕见病预测准确率。
AutoML-Med: A Framework for Automated Machine Learning in Medical Tabular Data
- 用拉丁超立方采样探索预处理方法,减少人工干预。
- 在临床数据上实现更高平衡准确率和敏感度,优于现有工具。
- 特别适合小样本、不平衡的医疗数据,助力精准诊疗。
医疗数据常面临缺失值、类别不平衡、特征类型异质以及高维低样本等挑战,导致机器学习模型在分类和回归任务中表现不佳。本文提出AutoML-Med,一个专为解决此类问题设计的自动化机器学习框架,旨在最小化用户参与,自动筛选最优预处理方案与预测模型组合。该框架采用拉丁超立方采样(LHS)搜索预处理策略,基于选定指标训练模型,并利用偏秩相关系数(PRCC)对关键预处理步骤进行精细化优化。实验在两种不同临床场景下验证了其有效性,相比其他先进工具,AutoML-Med在平衡准确率和敏感度方面表现更优,尤其有助于识别高风险患者。该方法在稀疏数据与类别不平衡的医疗数据中展现出显著提升预测性能的能力,具备推动医疗机器学习应用落地的潜力。
原文摘要 · Abstract (English)
Medical datasets are typically affected by issues such as missing values, class imbalance, a heterogeneous feature types, and a high number of features versus a relatively small number of samples, preventing machine learning models from obtaining proper results in classification and regression tasks. This paper introduces AutoML-Med, an Automated Machine Learning tool specifically designed to address these challenges, minimizing user intervention and identifying the optimal combination of preprocessing techniques and predictive models. AutoML-Med's architecture incorporates Latin Hypercube Sampling (LHS) for exploring preprocessing methods, trains models using selected metrics, and utilizes Partial Rank Correlation Coefficient (PRCC) for fine-tuned optimization of the most influential preprocessing steps. Experimental results demonstrate AutoML-Med's effectiveness in two different clinical settings, achieving higher balanced accuracy and sensitivity, which are crucial for identifying at-risk patients, compared to other state-of-the-art tools. AutoML-Med's ability to improve prediction results, especially in medical datasets with sparse data and class imbalance, highlights its potential to streamline Machine Learning applications in healthcare.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。