arXiv:2410.20978cs.LGstat.CO2024-10

用重要性加权改进决策树,缓解医疗数据分布差异问题

A Semi-supervised CART Model for Covariate Shift

  • 通过重要性加权让训练数据更贴近目标分布
  • 在无标签目标数据下仍显著提升预测准确率
  • 适用于医疗等存在分布偏移的场景

医学领域机器学习模型常因协变量偏移(covariate shift)面临挑战,即训练数据与目标数据分布不一致,导致预测性能下降,尤其在目标数据标签未知时更为明显。本文提出一种半监督分类与回归树(CART)模型,引入重要性加权机制,对更接近目标分布的训练样本赋予更高权重,从而提升模型预测性能。该方法不仅适用于CART,还可扩展至广义线性模型树和树集成,构建出一个应对复杂数据分布偏移的通用框架。通过模拟实验和真实医疗数据应用验证,该方法显著改善了预测准确性。结果表明,该加权策略能有效提升医疗等领域的模型可靠性,尤其在数据分布差异较大的场景中具有重要意义。

原文摘要 · Abstract (English)

Machine learning models used in medical applications often face challenges due to the covariate shift, which occurs when there are discrepancies between the distributions of training and target data. This can lead to decreased predictive accuracy, especially with unknown outcomes in the target data. This paper introduces a semi-supervised classification and regression tree (CART) that uses importance weighting to address these distribution discrepancies. Our method improves the predictive performance of the CART model by assigning greater weights to training samples that more accurately represent the target distribution, especially in cases of covariate shift without target outcomes. In addition to CART, we extend this weighted approach to generalized linear model trees and tree ensembles, creating a versatile framework for managing the covariate shift in complex datasets. Through simulation studies and applications to real-world medical data, we demonstrate significant improvements in predictive accuracy. These findings suggest that our weighted approach can enhance reliability in medical applications and other fields where the covariate shift poses challenges to model performance across various data distributions.

决策树协变量偏移半监督医疗AI

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。