生物医学数据中噪声限制了非线性模型的优势
Measurement noise limits the advantage of nonlinear models over linear models in biomedical prediction

- 噪声使非线性结构比线性结构更快被抹平
- 在典型生物测量可靠性下,非线性优势可能完全消失
- 提升测量精度才是突破瓶颈的关键,而非换模型
在生物医学表格数据中,深度网络、梯度提升树和核方法等灵活模型常被线性或逻辑回归超越。通常归因于模型能力不足,认为通过更多数据或更优架构可解决。但本文指出,当测量噪声是主要限制时,这些改进无效。加性噪声会模糊最优预测器,且因其先抹去函数的快速变化细节,而非线性结构的衰减速度远高于线性结构:一个k阶交互项的强度随特征可靠性的k次方衰减,而线性部分仅衰减一次。在典型的生物测量可靠性水平下,即使生物学本质为强非线性,非线性优势也可能消失。这种非线性并非不存在,而是被噪声隐藏。更大的样本量或更灵活的模型无法恢复被噪声擦除的信息,唯有改善测量精度才行。该结论基于测量误差统计、心理测量学与高斯分析的经典理论,构建了精确的超额风险恒等式。测量可靠性、样本量与特征表示是灵活模型有效的三个必要条件,三者需同时满足,而大多数生物医学任务均落在这一狭窄窗口之外。在140个英国生物银行任务中,灵活模型与线性模型的差距若存在,其特征符合预测的噪声模式;这三个条件可通过干预分离,但无法仅靠基准测试区分。
原文摘要 · Abstract (English)
On biomedical tabular data, flexible models such as deep networks, gradient-boosted trees, and kernel methods are repeatedly matched or beaten by linear and logistic regression given the same features. The usual reaction is to treat this as a model-side shortfall, to be fixed with more data, a better architecture, or tuning, on the assumption that the nonlinear structure is there and the model has failed to capture it. We argue that these fixes cannot help when the binding limit is the measurement rather than the model, as it frequently is in biomedicine. Additive noise blurs the population-optimal predictor, and because blurring removes a function's fine, rapidly varying detail before its broad shape, it erases nonlinear structure faster than linear structure. A degree-$k$ interaction is attenuated by the $k$-th power of feature reliability, while the linear part is attenuated only once. At the reliabilities typical of biomedical measurement, the nonlinear advantage can vanish even when the underlying biology is strongly nonlinear, and what the noise removes cannot be recovered by a larger cohort or a more flexible model, only by better measurement. The nonlinearity is hidden, not absent, and a tie between linear and flexible models is not by itself a verdict on the biology. These pieces are classical, drawn from measurement-error statistics, psychometrics, and Gaussian analysis, and we assemble them into an exact excess-risk identity. Measurement reliability is one of three conditions, alongside sample size and feature representation, that must align for a flexible model to help, and together they leave only a narrow window that most biomedical tasks fall outside. Across 140 UK Biobank tasks, the gap between flexible and linear models, where it exists, carries the predicted noise signature, and the three conditions can be separated by intervention but not by a benchmark alone.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。