arXiv:2608.26114cs.AIcs.CL2026-08

用多智能体框架让大模型算准金融题,准确率超95%。

CIFQA: A Deterministic Tool-Grounded Multi-Agent LLM Framework for Financial Query Answering

论文配图:CIFQA: A Deterministic Tool-Grounded Multi-Agent LLM Framework for Financial Query Answering
图 1 · 摘自论文原文
  • 分角色智能体分工:理解、查表、算账、生成,各司其职
  • 算术题准确率达95.54%,整体准确率90.87%,远超直接调用模型
  • 开源小模型胜过大模型,说明设计比规模更重要

计算密集型金融问答需对结构化利率、时间条件、数值公式和规则约束进行精确推理。尽管大语言模型在自然语言任务上表现优异,但在多步金融计算中常生成看似合理却数值错误的答案。为此,我们提出CIFQA(Calculation-Intensive Financial Query Answering),一个确定性的工具锚定多智能体大模型框架。CIFQA通过专用智能体分别负责查询理解、路由、参数提取、计算规划和响应生成,并由基于Python的确定性工具执行金融计算与规则应用。我们在定期存款查询任务上构建了精选基准并评估CIFQA,结果在计算密集型问题上达到95.54%准确率,总体准确率为90.87%,显著优于直接使用大模型的基线,即使提供完整公式、利率表和指导指令。消融实验表明,精确利率查找、存期计算、滚动年调整和提前支取逻辑等确定性组件是性能关键。值得注意的是,170亿参数的开源主干模型在CIFQA中表现优于更大规模的前沿模型,证明架构设计比模型规模更影响数值可靠性。尽管聚焦于定期存款查询,该框架可推广至其他计算密集型金融推理任务。

原文摘要 · Abstract (English)

Calculation-intensive financial question answering requires exact reasoning over structured rates, temporal conditions, numerical formulas, and rule-based constraints. Although Large Language Models (LLMs) perform strongly on natural language tasks, they often produce numerically incorrect yet plausible answers when solving multi-step financial calculations. To address this limitation, we introduce CIFQA (Calculation-Intensive Financial Query Answering), a deterministic tool-grounded multi-agent LLM framework for financial question answering. CIFQA separates language understanding from numerical execution by assigning specialized agents to query interpretation, routing, parameter extraction, computation planning, and response generation, while deterministic Python-based tools perform financial calculations and rule application. We instantiate CIFQA for fixed deposit query answering and evaluate it on a curated benchmark of fixed deposit queries. CIFQA achieves 95.54% accuracy on calculation-intensive queries and 90.87% overall accuracy, substantially outperforming direct LLM baselines even when provided with complete formulas, rate cards, and benchmark instructions. Ablation studies show that deterministic components such as exact rate lookup, tenure computation, rolling-year adjustment, and premature-withdrawal logic are critical contributors to performance. Notably, a 17B open-source backbone operating within CIFQA outperforms substantially larger frontier models evaluated with the same financial information, demonstrating that architectural design is a more important determinant of numerical reliability than model scale. While evaluated on fixed deposit queries, CIFQA provides a generalizable framework for calculation-intensive financial reasoning tasks.

金融问答多智能体确定性推理数值准确

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。