arXiv:2607.27853cs.CLcs.AI2026-07被引 1

构建金融深度研究自动化框架,解决信息泄露与专业性不足问题

FinanceHarness: Autonomous Financial Deep Research Framework

论文配图:FinanceHarness: Autonomous Financial Deep Research Framework
图 1 · 摘自论文原文
  • 设计分层工具链与流程控制,实现金融研究全流程自动化
  • 引入时间点验证机制,专家评审通过率达82%
  • 相比通用框架,评分提升7.1个百分点,仍难突破45%上限

基于大模型与自主代理的深度研究已广泛应用,但现有系统多生成通用报告,难以满足金融研究对专业知识和时序分析的需求。自动化金融深度研究需具备分层驱动机制与可验证的时间点基准,防止未来信息泄露。本文提出FinanceHarness,整合面向金融的工具与实践者指导流程,实现从环境搭建、数据准备、代理执行到奖励建模的端到端自动化。同时构建FinanceGym,包含基于论点的研究问题与结合预截止与后截止标准的评估体系。专业专家验证显示82%任务通过率。使用相同开源底座,FinanceHarness将整体评分从25.3%提升至32.4%,证明专用框架的有效性。即便采用最先进模型(如Opus-5),FinanceGym得分仍低于45%,表明该任务极具挑战性。排行榜及代码已公开。

原文摘要 · Abstract (English)

Powered by advances in LLMs and autonomous agents, deep research has become one of the most widely adopted agentic products. However, most deep research systems write general-purpose reports, which are inadequate for financial deep research. Financial research demands specialized knowledge to analyze historical patterns and forecast upcoming events. Automating financial deep research therefore requires both a layered harness to drive the research agent and a verifiable, point-in-time benchmark that prevents leakage of future information. We present FinanceHarness, a harness that runs finance-oriented tools and practitioner-guided workflows, automating financial deep research end to end: environment and data construction, the agent execution loop, and reward modeling. We further propose FinanceGym, comprising thesis-driven research questions and rubrics that combine pre-cutoff and post-cutoff criteria. Professional expert validation yields an 82% pass rate. With the same open-weight backbone, FinanceHarness improves the overall rubric score from 25.3% to 32.4%, demonstrating the effectiveness of our specialized harness design. However, even pairing FinanceHarness with the most cutting edge LLM (e.g. Opus-5), the FinanceGym score is below 45%, showing that it is a challenging benchmark for financial deep research. Leaderboard is available at: https://financegym.github.io/ and FinanceHarness code is available at: https://github.com/Yijia-Xiao/FinanceHarness.

金融AI自动研究评测基准

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。