arXiv:2512.17929q-fin.STcs.AI2025-12

用强化学习优化货币政策,简单方法反而更有效

Reinforcement Learning for Monetary Policy Under Macroeconomic Uncertainty: Analyzing Tabular and Function Approximation Methods

  • 将利率调整建模为序贯决策问题,用强化学习动态优化
  • 表格式Q-learning表现最佳,均值回报达-615.13,优于复杂模型
  • 适合研究政策制定与强化学习交叉应用的学者参考

我们研究在宏观经济关系不确定且时变的情况下,央行如何动态设定短期名义利率以稳定通胀和失业率。将货币政策建模为序列决策问题,央行每季度观测宏观经济状况并决定利率调整。基于公开的联邦储备经济数据(FRED),构建线性高斯转移模型,设计离散动作马尔可夫决策过程,并采用二次损失奖励函数。对比了九种强化学习方法与泰勒规则及朴素基线,包括表格式Q-learning、SARSA、Actor-Critic、深度Q网络、带不确定性量化的贝叶斯Q-learning,以及部分可观测的POMDP模型。值得注意的是,尽管结构简单,标准表格式Q-learning表现最优(均值回报-615.13 ± 309.58),优于增强型强化学习方法和传统政策规则。结果表明,虽然先进强化学习方法在货币政策中具有潜力,但简单方法在此领域可能更具鲁棒性,凸显了现代强化学习应用于宏观经济政策的挑战。

原文摘要 · Abstract (English)

We study how a central bank should dynamically set short-term nominal interest rates to stabilize inflation and unemployment when macroeconomic relationships are uncertain and time-varying. We model monetary policy as a sequential decision-making problem where the central bank observes macroeconomic conditions quarterly and chooses interest rate adjustments. Using publicly accessible historical Federal Reserve Economic Data (FRED), we construct a linear-Gaussian transition model and implement a discrete-action Markov Decision Process with a quadratic loss reward function. We chose to compare nine different reinforcement learning style approaches against Taylor Rule and naive baselines, including tabular Q-learning variants, SARSA, Actor-Critic, Deep Q-Networks, Bayesian Q-learning with uncertainty quantification, and POMDP formulations with partial observability. Notably, despite its simplicity, standard tabular Q-learning achieved the best performance (-615.13 +- 309.58 mean return), outperforming both enhanced RL methods and traditional policy rules. Our results suggest that while sophisticated RL techniques show promise for monetary policy applications, simpler approaches may be more robust in this domain, highlighting important challenges in applying modern RL to macroeconomic policy.

强化学习货币政策决策优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。