用深度神经网络提升个体治疗效应估计的准确性与不确定性量化。
Extended Fiducial Inference for Individual Treatment Effects via Deep Neural Networks
- 构建双神经网络模型分别拟合处理组与对照组效应函数。
- 在样本量增长时,模型规模可增至O(n^ζ)且仍保持误差可控。
- 为大规模神经网络提供严格的不确定性分析框架,适合高维数据建模者。
个体治疗效应估计在近年数据科学文献中备受关注。本文提出双神经网络(Double-NN)方法,在扩展似然推断(EFI)框架下解决该问题。该方法利用深度神经网络建模处理组与对照组效应函数,并引入额外神经网络估计其参数。由于深度神经网络具备普遍逼近能力,本方法具有广泛适用性。数值实验表明,与分位数回归(CQR)相比,Double-NN 在个体治疗效应估计上表现更优。从统计推断角度,理论证明所提方法允许模型规模随样本量n以O(n^ζ)速率增长(0 ≤ ζ < 1),仍能正确量化参数不确定性,显著优于经典中心极限定理要求的ζ < 1/2。此外,本文建立了神经尺度律下深度神经网络不确定性量化的严格框架,极大推进了对大规模神经网络统计性质的理解。
原文摘要 · Abstract (English)
Individual treatment effect estimation has gained significant attention in recent data science literature. This work introduces the Double Neural Network (Double-NN) method to address this problem within the framework of extended fiducial inference (EFI). In the proposed method, deep neural networks are used to model the treatment and control effect functions, while an additional neural network is employed to estimate their parameters. The universal approximation capability of deep neural networks ensures the broad applicability of this method. Numerical results highlight the superior performance of the proposed Double-NN method compared to the conformal quantile regression (CQR) method in individual treatment effect estimation. From the perspective of statistical inference, this work advances the theory and methodology for statistical inference of large models. Specifically, it is theoretically proven that the proposed method permits the model size to increase with the sample size $n$ at a rate of $O(n^ζ)$ for some $0 \leq ζ<1$, while still maintaining proper quantification of uncertainty in the model parameters. This result marks a significant improvement compared to the range $0\leq ζ< \frac{1}{2}$ required by the classical central limit theorem. Furthermore, this work provides a rigorous framework for quantifying the uncertainty of deep neural networks under the neural scaling law, representing a substantial contribution to the statistical understanding of large-scale neural network models.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。