揭示谱方法在噪声下的稳定性极限,发现系数估计存在不可逾越的噪声阈值。
Limits of spectral learning under noise

- 通过多基多维稀疏谱表示,分析加性标签噪声对系数的影响机制。
- 噪声导致系数向量产生可预测漂移,其幅度由有效活跃谱模态数决定。
- 适用于需要高精度函数重构的科学计算与信号处理场景。
从噪声数据中学习函数关系是科学推断的核心问题。谱方法通过基展开近似未知函数并从数据中估计系数,但系数在噪声下的稳定性仍不清晰。本文研究了带加性标签噪声的监督回归问题,采用跨多个基和维度的稀疏谱表示。结果表明,噪声会引起学习到的系数向量出现可预测的漂移,其大小取决于有效活跃谱模态数量。在对经验特征几何进行去相关处理后,我们推导出噪声与无噪系数向量重叠的闭式表达,揭示了一个由单一内在噪声尺度决定的普适退化曲线。在傅里叶、勒让德、贝塞尔和哈尔基上的数值实验验证了理论预测。结果表明,谱学习存在一个根本性的噪声阈值,超过该阈值后系数估计将变得不稳定,这为从噪声数据中恢复函数结构设定了内在限制。
原文摘要 · Abstract (English)
Learning functional relationships from noisy data is a central problem in scientific inference. Spectral methods approximate unknown functions by expanding them in a basis and estimating the corresponding coefficients from data, but the stability of these coefficients under noise remains poorly understood. Here we study supervised regression with additive label noise using sparse spectral representations across multiple bases and dimensions. We show that noise induces a predictable drift in the learned coefficient vector whose magnitude depends on the effective number of active spectral modes. After whitening the empirical feature geometry, we derive a closed-form expression for the overlap between noisy and noiseless coefficient vectors, revealing a universal degradation curve governed by a single intrinsic noise scale. Numerical experiments across Fourier, Legendre, Bessel, and Haar bases confirm the theoretical prediction. The results demonstrate that spectral learning exhibits a fundamental noise threshold beyond which coefficient estimates become unstable, placing intrinsic limits on recovering functional structure from noisy data.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。