用外部机器学习预测提升主研究分类模型的精度与效率
Fused Multinomial Logistic Regression Utilizing Summary-Level External Machine-learning Information
- 通过矩约束融合外部黑箱预测,不依赖密度比建模
- 在多分类血压预测中实现比仅用主数据更优的估计效率
- 适用于数据质量差或分布偏移场景,适合医学统计研究
在许多现代应用中,主研究提供个体层面数据以实现可解释建模,而外部信息则以摘要级机器学习预测形式存在,具有高效、非参数化和黑箱特性。尽管摘要级外部信息已在数据融合领域被研究,但如何利用外部非参数机器学习预测来改进主研究的统计推断仍缺乏方法。本文提出一种通用的经验似然框架,通过矩约束融入外部预测。非参数机器学习预测的优势在于,在弱重叠条件下无需显式建模密度比即可产生丰富且对协变量偏移稳健的有效矩限制。本文聚焦于多项逻辑回归作为主模型,处理外部数据中常见的问题,包括结果粗化、部分观测协变量、协变量偏移及生成机制异质性(概念漂移)。建立了融合估计器的大样本性质,包括一致性与渐近正态性。此外,给出了在温和充分条件下,融合外部预测可带来严格效率提升的结论。模拟研究与对国家健康与营养调查中多类血压分类的应用验证了该方法的有效性。
原文摘要 · Abstract (English)
In many modern applications, a carefully designed primary study provides individual-level data for interpretable modeling, while summary-level external information is available through black-box, efficient, and nonparametric machine-learning predictions. Although summary-level external information has been studied in the data integration literature, there is limited methodology for leveraging external nonparametric machine-learning predictions to improve statistical inference in the primary study. We propose a general empirical-likelihood framework that incorporates external predictions through moment constraints. An advantage of nonparametric machine-learning prediction is that it induces a rich class of valid moment restrictions that remain robust to covariate shift under a mild overlap condition without requiring explicit density-ratio modeling. We focus on multinomial logistic regression as the primary model and address common data-quality issues in external sources, including coarsened outcomes, partially observed covariates, covariate shift, and heterogeneity in generating mechanisms known as concept shift. We establish large-sample properties of the resulting fused estimator, including consistency and asymptotic normality under regularity conditions. Moreover, we provide mild sufficient conditions under which incorporating external predictions delivers a strict efficiency gain relative to the primary-only estimator. Simulation studies and an application to the National Health and Nutrition Examination Survey on multiclass blood-pressure classification.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。