arXiv:2412.13076econ.EMcs.LG2024-12被引 5

用历史相似事件解释机器学习预测,让黑箱模型更透明。

Dual Interpretation of Machine Learning Forecasts

  • 将预测看作历史事件的加权组合,权重来自事件相似度。
  • 在数据少、变量多时,解释更简洁,可可视化为时间序列。
  • 适用于宏观预测,能诊断模型依赖历史重复的程度。

机器学习预测通常被解释为各变量贡献之和,但每个外样本预测也可表示为历史观测值的线性组合,权重对应当前与过去经济事件间的成对相似度。该双重视角在大规模横截面数据中无优势,但在变量多、训练数据少的场景(如宏观经济预测)中提供更稀疏的解释。此时,贡献序列可可视化为时间序列,使预测被理解为历史类比的可量化组合。权重可视为数据投资组合,催生新诊断指标如预测集中度、空头暴露和周转率。我们展示了如何为(核)岭回归、随机森林、提升树和神经网络无缝获取这些权重,并应用于疫情后通胀、GDP增长与衰退概率的预测分析。结果表明,该方法从新角度打开黑箱,揭示模型如何利用历史重复的模式。

原文摘要 · Abstract (English)

Machine learning predictions are typically interpreted as the sum of contributions of predictors. Yet, each out-of-sample prediction can also be expressed as a linear combination of in-sample values of the predicted variable, with weights corresponding to pairwise proximity scores between current and past economic events. While this dual route leads nowhere in some contexts (e.g., large cross-sectional datasets), it provides sparser interpretations in settings with many regressors and little training data-like macroeconomic forecasting. In this case, the sequence of contributions can be visualized as a time series, allowing analysts to explain predictions as quantifiable combinations of historical analogies. Moreover, the weights can be viewed as those of a data portfolio, inspiring new diagnostic measures such as forecast concentration, short position, and turnover. We show how weights can be retrieved seamlessly for (kernel) ridge regression, random forest, boosted trees, and neural networks. Then, we apply these tools to analyze post-pandemic forecasts of inflation, GDP growth, and recession probabilities. In all cases, the approach opens the black box from a new angle and demonstrates how machine learning models leverage history partly repeating itself.

模型解释宏观预测历史类比黑箱诊断

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。