arXiv:2508.20103q-fin.PMcs.AI2025-08中稿 · manuscript, to app…被引 1

用DDPG+TiDE模型实现动态资产配置,提升投资回报

Deep Reinforcement Learning for Optimal Asset Allocation Using DDPG with TiDE

  • 将资产配置建模为马尔可夫决策过程,用DDPG+TiDE做连续决策
  • 实测收益高于Q-learning和买入持有策略,风险调整后表现更优
  • 适合对量化投资与强化学习结合感兴趣的从业者

由于金融市场固有的波动性,风险资产与无风险资产之间的最优配置始终是一个挑战。传统方法依赖严格的分布假设或非加性奖励比率,限制了其鲁棒性和适用性。本文将双资产配置问题建模为马尔可夫决策过程(MDP),使强化学习机制可在无需前提假设的模拟场景下生成动态策略。采用凯利准则平衡短期回报与长期目标,并首次将时间序列密集编码器(TiDE)引入深度确定性策略梯度(DDPG)框架,实现连续决策。对比实验显示,DDPG-TiDE优于简单离散动作的Q-learning,且风险调整后收益超过被动买入持有策略。结果表明,将TiDE嵌入DDPG框架是解决最优资产配置问题的有效路径。

原文摘要 · Abstract (English)

The optimal asset allocation between risky and risk-free assets is a persistent challenge due to the inherent volatility in financial markets. Conventional methods rely on strict distributional assumptions or non-additive reward ratios, which limit their robustness and applicability to investment goals. To overcome these constraints, this study formulates the optimal two-asset allocation problem as a sequential decision-making task within a Markov Decision Process (MDP). This framework enables the application of reinforcement learning (RL) mechanisms to develop dynamic policies based on simulated financial scenarios, regardless of prerequisites. We use the Kelly criterion to balance immediate reward signals against long-term investment objectives, and we take the novel step of integrating the Time-series Dense Encoder (TiDE) into the Deep Deterministic Policy Gradient (DDPG) RL framework for continuous decision-making. We compare DDPG-TiDE with a simple discrete-action Q-learning RL framework and a passive buy-and-hold investment strategy. Empirical results show that DDPG-TiDE outperforms Q-learning and generates higher risk adjusted returns than buy-and-hold. These findings suggest that tackling the optimal asset allocation problem by integrating TiDE within a DDPG reinforcement learning framework is a fruitful avenue for further exploration.

资产配置强化学习时间序列DDPG

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。