大模型能生成金融计算中又快又准的硬件吗?
FinHardBench: Can LLMs Generate Latency-Aware Hardware for Financial Computing?

- 用大模型从需求生成硬件模块,再优化流水线配置
- 部分模型生成代码正确率仅19%-61%,延迟最高超13倍
- 在系统级设计中表现优于传统优化方法,适合金融硬件研发
大语言模型能否不仅生成正确的硬件,还能生成快速的硬件?本文在金融FPGA设计场景下探讨这一问题,该场景中5-10纳秒的延迟差异决定竞争优势,且设计需随协议、策略和监管持续迭代。本文提出一个包含33个金融计算任务的基准测试集FinHardBench,以及三个模拟真实FPGA迭代流程的实验:从规格生成新模块、在六阶段交易流水线中调优系统级配置、适配已有模块应对规格变更。对六个大模型在1530+轮实验中的评估显示:(1)模型功能正确率19%-61%,特定任务延迟最高达原设计的13.7倍;(2)在系统级设计空间探索中,顶尖模型在24轮内以5/5种子收敛至最优配置,优于随机搜索、模拟退火和贝叶斯优化(后三者最多仅0-4/5成功);(3)多数模型无法解决策略级规格变更问题。六模型间生成与设计空间探索排名相关性中等:最强代码生成器非最快架构优化器,最弱生成器(MiniMax M2.7)仍能在5次试验中4次达到系统最优。任务难度更依赖训练数据模式可得性,而非抽象层级。FinHardBench已开源。
原文摘要 · Abstract (English)
Can large language models generate not just correct, but fast hardware? This paper investigates the question in financial FPGA design, where 5-10 nanoseconds of latency determines competitive advantage and designs iterate continuously as protocols, strategies, and regulations evolve. FinHardBench, a benchmark of 33 financial computing tasks, is presented together with three experiments that mirror the real-world FPGA iteration cycle: generating new modules from specifications, tuning system-level configurations across a 6-stage trading pipeline, and adapting existing modules to specification changes. Evaluation of six LLMs on 1530+ experiment rounds yields three findings: (1) models achieve 19-61% functional correctness with timing degradation up to 13.7$\times$ on specific tasks; (2) in system-level design space exploration, top LLMs converge to the optimal configuration with higher reliability than random search, simulated annealing, and Bayesian optimization baselines (5/5 seeds vs. 0-4/5 at the same 24-round budget); (3) strategy-level specification changes remain unsolved for most models. Across the six models, generation and DSE rankings overlap moderately: the strongest code generator is not the fastest architecture optimizer, and the weakest code generator (MiniMax M2.7) still reaches the system optimum on 4 of 5 seeds. On the tasks in FinHardBench, difficulty tracks training data pattern availability more closely than abstraction level. FinHardBench is released as an open-source benchmark.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。