用强化学习优化投资组合,目标是按时达成收益且减少定期投入。
Reinforcement Learning for Portfolio Optimization with a Financial Goal and Defined Time Horizons
- 结合G-Learning与逆强化学习优化投资策略
- 夏普比率从0.42提升至0.483,显著改善表现
- 适合关注长期稳健收益的量化投资者
本研究提出一种基于G-Learning算法的改进型投资组合优化方法,并结合参数化逆强化学习(GIRL)进行奖励函数调优。目标是在固定期限内最大化投资组合价值,同时最小化投资者的周期性资金投入。模型在高度波动的市场中运行,配置多样化资产组合,有效控制风险。实验结果表明,夏普比率由先前研究的0.42提升至0.483,在高波动性与分散化条件下表现突出。对比G-Learning与GIRL发现,尽管后者将参数λ优化至0.0012(原为0.002),但对实际绩效影响有限,说明G-Learning已具备强鲁棒性。研究推动了强化学习在金融决策中的应用,验证了概率学习算法可有效匹配投资者需求。
原文摘要 · Abstract (English)
This research proposes an enhancement to the innovative portfolio optimization approach using the G-Learning algorithm, combined with parametric optimization via the GIRL algorithm (G-learning approach to the setting of Inverse Reinforcement Learning) as presented by. The goal is to maximize portfolio value by a target date while minimizing the investor's periodic contributions. Our model operates in a highly volatile market with a well-diversified portfolio, ensuring a low-risk level for the investor, and leverages reinforcement learning to dynamically adjust portfolio positions over time. Results show that we improved the Sharpe Ratio from 0.42, as suggested by recent studies using the same approach, to a value of 0.483 a notable achievement in highly volatile markets with diversified portfolios. The comparison between G-Learning and GIRL reveals that while GIRL optimizes the reward function parameters (e.g., lambda = 0.0012 compared to 0.002), its impact on portfolio performance remains marginal. This suggests that reinforcement learning methods, like G-Learning, already enable robust optimization. This research contributes to the growing development of reinforcement learning applications in financial decision-making, demonstrating that probabilistic learning algorithms can effectively align portfolio management strategies with investor needs.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。