arXiv:2603.27074stat.APcs.IT2026-03被引 1

用信息论定义预测能力,判断数据能否被有效预测。

Forecastability as an Information-Theoretic Limit on Prediction

  • 以互信息衡量不同预测时点的可预测性,揭示信息结构
  • 发现预测损失可分解为不可压缩部分与方法误差部分
  • 适合评估模型前是否具备足够预测信息,尤其对时序数据

预测通常被视为模型选择问题。本文更进一步,探讨在每个预测时点上可用的预测信息量。在对数损失下,答案是精确的:未来观测与已知信息集之间的互信息,等于预期损失的最大可降低量。本文推导了该等式的意义:可预测性(即互信息随时点变化的分布)反映了过程的依赖结构,未必单调。三个结构性结论被建立:压缩信息集只会降低可预测性;有限滞后窗口与完整历史之间的差距给出了截断误差的精确预算;具有周期依赖性的过程,其可预测性也呈周期性。预测损失可分解为由信息结构决定的不可约部分和由方法造成的近似部分;二者之比定义了利用比率,用于衡量方法的有效性。该等式仅对对数损失成立,但当可预测性接近零时,经典不等式表明,任何损失下任何方法都无法显著优于无条件基线。该框架为建模前评估信息集在目标时点是否包含足够预测信息提供了理论基础。

原文摘要 · Abstract (English)

Forecasting is usually framed as a problem of model choice. This paper starts earlier, asking how much predictive information is available at each horizon. Under logarithmic loss, the answer is exact: the mutual information between the future observation and the declared information set equals the maximum achievable reduction in expected loss. This paper develops the consequences of that identity. Forecastability, defined as this mutual information evaluated across horizons, forms a profile whose shape reflects the dependence structure of the process and need not be monotone. Three structural properties are derived: compression of the information set can only reduce forecastability; the gap between the profile under a finite lag window and the full history gives an exact truncation error budget; and for processes with periodic dependence, the profile inherits the periodicity. Predictive loss decomposes into an irreducible component fixed by the information structure and an approximation component attributable to the method; their ratio defines the exploitation ratio, a normalised diagnostic for method adequacy. The exact equality is specific to log loss, but when forecastability is near zero, classical inequalities imply that no method under any loss can materially improve on the unconditional baseline. The framework provides a theoretical foundation for assessing, prior to any modelling, whether the declared information set contains sufficient predictive information at the horizon of interest.

信息论预测评估时序分析

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。