arXiv:2510.11695cs.CL2025-10被引 16

首个实时多市场交易基准,测试大模型代理在真实行情中的表现

When Agents Trade: Live Multi-Market Trading Benchmark for LLM Agents

  • 构建统一框架,整合真实数据与新闻,支持持续评估
  • 不同代理行为差异显著,模型版本对结果影响较小
  • 适合研究金融推理与智能交易的开发者和学者

尽管基于大语言模型(LLM)的代理在金融交易中应用日益广泛,但其在真实市场中是否具备推理与适应能力仍不明确。现有研究多测试模型而非代理,覆盖周期与资产有限,且依赖未经验证的数据。为此,我们提出首个终身、实时的多市场交易评估基准——Agent Market Arena(AMA)。AMA整合经验证的交易数据、专家审核的新闻信息,并在统一框架内支持多种代理架构,实现真实条件下的公平、持续对比。它包含四种代理:InvestorAgent(单代理基线)、TradeAgent与HedgeFundAgent(不同风险风格)、DeepFundAgent(基于记忆的推理),并评估GPT-4o、GPT-4.1、Claude-3.5-haiku、Claude-sonnet-4与Gemini-2.0-flash五种模型。在加密货币与股票市场的实时实验表明,代理框架表现出从激进到保守的显著行为差异,而模型骨干对结果影响较小。AMA为金融推理与交易智能的严谨、可复现、持续演进评估奠定了基础。

原文摘要 · Abstract (English)

Although Large Language Model (LLM)-based agents are increasingly used in financial trading, it remains unclear whether they can reason and adapt in live markets, as most studies test models instead of agents, cover limited periods and assets, and rely on unverified data. To address these gaps, we introduce Agent Market Arena (AMA), the first lifelong, real-time benchmark for evaluating LLM-based trading agents across multiple markets. AMA integrates verified trading data, expert-checked news, and diverse agent architectures within a unified trading framework, enabling fair and continuous comparison under real conditions. It implements four agents, including InvestorAgent as a single-agent baseline, TradeAgent and HedgeFundAgent with different risk styles, and DeepFundAgent with memory-based reasoning, and evaluates them across GPT-4o, GPT-4.1, Claude-3.5-haiku, Claude-sonnet-4, and Gemini-2.0-flash. Live experiments on both cryptocurrency and stock markets demonstrate that agent frameworks display markedly distinct behavioral patterns, spanning from aggressive risk-taking to conservative decision-making, whereas model backbones contribute less to outcome variation. AMA thus establishes a foundation for rigorous, reproducible, and continuously evolving evaluation of financial reasoning and trading intelligence in LLM-based agents.

金融代理实时评估多市场LLM交易

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。