arXiv:2502.17518cs.LGcs.AI2025-02被引 1

用分类器增强强化学习,提升交易策略的风险收益比

Ensemble RL through Classifier Models: Enhancing Risk-Return Trade-offs in Trading Strategies

  • 将RL算法与SVM、决策树等分类器结合,动态选择最优策略
  • 集成方法在夏普比率和最大回撤上均优于单一模型
  • 适合关注风险控制的量化交易研究者参考

本文系统研究了在金融交易策略中使用集成强化学习(RL)模型的可行性,通过引入分类器模型提升性能。将A2C、PPO、SAC等RL算法与支持向量机(SVM)、决策树、逻辑回归等传统分类器结合,探究不同分类器组合对风险-收益权衡的影响。实验对比了多种集成方法与单个RL模型在累积收益、夏普比率(SR)、Calmar比率及最大回撤(MDD)等关键指标上的表现。结果表明,集成方法在风险调整后收益上普遍优于基线模型,有效控制回撤并提升稳定性。然而,原始分析与本版本补充的复现结果均显示,集成性能对方差阈值τ、分类器组、RL-agent组合及市场范围高度敏感。复现证据进一步验证了分类器辅助的集成选择可增强鲁棒性,但优势具有条件性,并非在所有数据集上自动成立。研究强调将RL与分类器结合对自适应决策的价值,对金融交易、机器人及其他动态环境具有启示意义。

原文摘要 · Abstract (English)

This paper presents a comprehensive study on the use of ensemble Reinforcement Learning (RL) models in financial trading strategies, leveraging classifier models to enhance performance. By combining RL algorithms such as A2C, PPO, and SAC with traditional classifiers like Support Vector Machines (SVM), Decision Trees, and Logistic Regression, we investigate how different classifier groups can be integrated to improve risk-return trade-offs. The study evaluates the effectiveness of various ensemble methods, comparing them with individual RL models across key financial metrics, including Cumulative Returns, Sharpe Ratios (SR), Calmar Ratios, and Maximum Drawdown (MDD). Our original experimental results demonstrate that ensemble methods often outperform base models in terms of risk-adjusted returns, providing better management of drawdowns and overall stability. However, both the original analysis and the additional reproduction reported in this version show that ensemble performance is sensitive to the choice of variance threshold \(τ\), classifier group, RL-agent pair, and market universe. The reproduction evidence strengthens the conclusion that classifier-assisted ensemble selection can improve robustness, while also clarifying that the advantage is conditional rather than automatic across all datasets. This study emphasizes the value of combining RL with classifiers for adaptive decision-making, with implications for financial trading, robotics, and other dynamic environments.

强化学习交易策略集成学习风险控制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。