arXiv:2509.11420q-fin.TRcs.AI2025-09被引 16

用强化学习让大模型学会像人类分析师一样做金融交易决策。

Trading-R1: Financial Trading with LLM Reasoning via Reinforcement Learning

  • 通过三阶段渐进式训练,让LLM结合金融常识进行分步推理与决策。
  • 在6只主要股票和ETF上实现更高风险调整收益与更低回撤。
  • 生成可解释的投研报告,适合需要透明交易逻辑的机构用户。

构建专业级、结构化的金融推理能力仍是金融AI的核心挑战,市场要求决策具备可解释性与可信度。传统时间序列模型缺乏可解释性,而大语言模型难以将自然语言分析转化为严谨可执行的交易行为。尽管推理型大模型在分步规划与验证方面取得进展,但在高风险金融决策中的应用仍不充分。我们提出Trading-R1,一种融合战略思维与计划能力的金融感知模型,支持完整论点构建、事实依据分析及波动率调整决策。通过监督微调与三阶段由易到难的强化学习训练,结合包含18个月、14只股票及5种异构数据源的Tauric-TR1-DB(10万样本)数据集进行训练。在6只主要股票与ETF上的评估显示,Trading-R1在风险调整后收益和回撤控制上均优于开源与商用指令跟随模型及推理模型。系统能生成结构化、基于证据的投资分析报告,支持可解释、有纪律的交易决策。Trading-R1终端将于https://github.com/TauricResearch/Trading-R1发布。

原文摘要 · Abstract (English)

Developing professional, structured reasoning on par with human financial analysts and traders remains a central challenge in AI for finance, where markets demand interpretability and trust. Traditional time-series models lack explainability, while LLMs face challenges in turning natural-language analysis into disciplined, executable trades. Although reasoning LLMs have advanced in step-by-step planning and verification, their application to risk-sensitive financial decisions is underexplored. We present Trading-R1, a financially-aware model that incorporates strategic thinking and planning for comprehensive thesis composition, facts-grounded analysis, and volatility-adjusted decision making. Trading-R1 aligns reasoning with trading principles through supervised fine-tuning and reinforcement learning with a three-stage easy-to-hard curriculum. Training uses Tauric-TR1-DB, a 100k-sample corpus spanning 18 months, 14 equities, and five heterogeneous financial data sources. Evaluated on six major equities and ETFs, Trading-R1 demonstrates improved risk-adjusted returns and lower drawdowns compared to both open-source and proprietary instruction-following models as well as reasoning models. The system generates structured, evidence-based investment theses that support disciplined and interpretable trading decisions. Trading-R1 Terminal will be released at https://github.com/TauricResearch/Trading-R1.

金融AI大模型推理强化学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。