揭示物理先验如何影响学习误差,给出理论依据。
Complexity Dependent Error Rates for Physics-informed Statistical Learning via the Small-ball Method
- 用小球方法分析物理约束下的学习误差
- 物理先验可降低模型复杂度,提升性能
- 适用于有物理规律的凸函数类问题
物理信息统计学习(PISL)将实测数据与物理知识结合,以提升估计器的统计性能。尽管该方法广泛应用,但其理论基础仍不完善。本文针对凸函数类中由线性方程表达的物理知识,基于小球方法构建了依赖复杂度的误差率分析框架。在合理假设下,我们证明:(1) 物理信息估计器的误差率与硬约束经验误差最小化器相当,仅差常数项;(2) 带物理先验的正则化能有效降低模型复杂度,类似降维,从而改善学习效果。本研究为凸函数类中的物理信息估计器提供了理论评价框架,弥合了统计理论与实际应用之间的差距,对文献未覆盖的情形亦具潜力。
原文摘要 · Abstract (English)
Physics-informed statistical learning (PISL) integrates empirical data with physical knowledge to enhance the statistical performance of estimators. While PISL methods are widely used in practice, a comprehensive theoretical understanding of how informed regularization affects statistical properties is still missing. Specifically, two fundamental questions have yet to be fully addressed: (1) what is the trade-off between considering soft penalties versus hard constraints, and (2) what is the statistical gain of incorporating physical knowledge compared to purely data-driven empirical error minimisation. In this paper, we address these questions for PISL in convex classes of functions under physical knowledge expressed as linear equations by developing appropriate complexity dependent error rates based on the small-ball method. We show that, under suitable assumptions, (1) the error rates of physics-informed estimators are comparable to those of hard constrained empirical error minimisers, differing only by constant terms, and that (2) informed penalization can effectively reduce model complexity, akin to dimensionality reduction, thereby improving learning performance. This work establishes a theoretical framework for evaluating the statistical properties of physics-informed estimators in convex classes of functions, contributing to closing the gap between statistical theory and practical PISL, with potential applications to cases not yet explored in the literature.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。