提出MIBoost算法,实现多重插补数据下的统一变量选择。
MIBoost: A gradient boosting algorithm for variable selection after multiple imputation
- 基于梯度提升框架,设计跨插补数据的统一变量选择机制
- 模拟实验显示预测性能媲美已有方法,且可直接用于实践
- 适合处理缺失数据并需变量选择的研究者使用
统计学习中的自动变量选择方法(如LASSO、弹性网和梯度提升)在构建强预测模型中日益流行。然而,实际分析常受缺失数据困扰。多重插补是处理缺失数据的常用方法,即生成多个完整数据集。但如何在多重插补数据上进行模型选择仍存争议。简单合并各数据集模型的方法表现不佳。虽有更优方法,但实现复杂,应用有限。现有研究已将LASSO和弹性网扩展至多重插补数据,通过定义单一损失函数实现系数统一。本文核心贡献是将此思想拓展至分量式梯度提升,提出MIBoost算法,结合其对应的交叉验证方法MIBoostCV。模拟研究表明,MIBoost的预测性能与现有成熟方法相当,为多重插补数据提供了实用的提升型变量选择方案。该框架已实现为R包booami。
原文摘要 · Abstract (English)
Statistical learning methods for automated variable selection, such as the Least Absolute Shrinkage and Selection Operator (LASSO), elastic nets, and gradient boosting, have become increasingly popular tools for building powerful prediction models. Yet, in practice, analyses are often complicated by missing data. The most widely used approach to address missingness is multiple imputation, which involves creating several completed datasets. However, there is an ongoing debate about how to perform model selection in the presence of multiple imputed datasets. Simple strategies, such as pooling models across datasets, have been shown to have suboptimal properties. Although more sophisticated methods exist, they are often difficult to implement and therefore not widely applied. In contrast, two recent approaches extend the regularization methods LASSO and elastic nets to multiply imputed datasets by defining a single loss function, resulting in a unified set of coefficients across imputations. Our key contribution is to extend this principle to the framework of component-wise gradient boosting by proposing MIBoost, a novel algorithm that employs a uniform variable-selection mechanism across imputed datasets, together with its corresponding cross-validation routine MIBoostCV. In a simulation study, MIBoost yielded predictive performance comparable to that of other established methods, providing a practical boosting-based approach for variable selection with multiply imputed data. The proposed framework is implemented as the R package booami.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。