让大模型在真实股市中竞争交易,发现图表比文字更助推理。
Agent Trading Arena: A Study on Numerical Understanding in LLM-Based Agents
- 构建虚拟零和股市,让LLM agent实时影响价格
- 图表输入使模型数值推理能力提升,交易表现更好
- 反思模块配合视觉输入效果更佳,尤其在高波动市场
大语言模型在自然语言任务中表现优异,但在动态真实金融环境中的表现仍不明确。现有方法仅限历史回测,交易行为无法影响市场价格,且训练依赖静态数据。为此,我们提出Agent Trading Arena,一个虚拟零和股票市场,其中基于LLM的智能体进行多智能体竞争交易,直接作用于价格动态。通过模拟真实的买卖交互,该平台使训练场景更贴近实际市场,缩小训练与评估之间的差距。实验表明,当仅提供纯文本数据时,LLM在数值推理上表现不佳,常过拟合局部模式和近期数值;而采用图表可视化显著提升数值理解与交易性能。此外,引入反思模块进一步改善表现,尤其在视觉输入下效果更明显。在NASDAQ与CSI数据集上的评估显示,本方法在高波动环境下优势显著。所有代码与数据公开于https://github.com/wekjsdvnm/Agent-Trading-Arena。
原文摘要 · Abstract (English)
Large language models (LLMs) have demonstrated remarkable capabilities in natural language tasks, yet their performance in dynamic, real-world financial environments remains underexplored. Existing approaches are limited to historical backtesting, where trading actions cannot influence market prices and agents train only on static data. To address this limitation, we present the Agent Trading Arena, a virtual zero-sum stock market in which LLM-based agents engage in competitive multi-agent trading and directly impact price dynamics. By simulating realistic bid-ask interactions, our platform enables training in scenarios that closely mirror live markets, thereby narrowing the gap between training and evaluation. Experiments reveal that LLMs struggle with numerical reasoning when given plain-text data, often overfitting to local patterns and recent values. In contrast, chart-based visualizations significantly enhance both numerical reasoning and trading performance. Furthermore, incorporating a reflection module yields additional improvements, especially with visual inputs. Evaluations on NASDAQ and CSI datasets demonstrate the superiority of our method, particularly under high volatility. All code and data are available at https://github.com/wekjsdvnm/Agent-Trading-Arena.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。