用原子化验证技术精准识别金融问答中的虚假数据和错误计算。
FinGround: Detecting and Grounding Financial Hallucinations via Atomic Claim Verification
- 将金融答案拆解为六类原子事实,按类型匹配验证策略。
- 在相同检索条件下,比最强基线减少68%幻觉,全链路降78%。
- 轻量模型可实现每查询0.003元成本,适合实际部署。
金融AI系统需基于具体监管文件生成答案,但现有大模型常虚构指标、编造引用、计算错误。这些错误在欧盟《人工智能法案》高风险监管截止日(2026年8月)前尤为危险。当前幻觉检测方法对所有声明一视同仁,漏检43%需算术复核的计算错误。我们提出FinGround,三阶段验证-定位流水线:第一阶段采用金融感知的混合检索(文本与表格);第二阶段将回答分解为六类原子声明,通过分类路由策略(包括公式重构)进行验证;第三阶段重写无支持的声明,附带段落与表格单元级引用。为独立评估验证效果,提出检索等值评估法——当各系统使用相同检索结果时,FinGround仍比最强基线降低68%幻觉率($p < 0.01$)。完整流程相较GPT-4o降低78%幻觉。8B轻量版检测器保持91.4% F1,延迟降低18倍,支持每查询0.003元部署,经四周期分析师试点验证有效。
原文摘要 · Abstract (English)
Financial AI systems must produce answers grounded in specific regulatory filings, yet current LLMs fabricate metrics, invent citations, and miscalculate derived quantities. These errors carry direct regulatory consequences as the EU AI Act's high-risk enforcement deadline approaches (August 2026). Existing hallucination detectors treat all claims uniformly, missing 43% of computational errors that require arithmetic re-verification against structured tables. We present FinGround, a three-stage verify-then-ground pipeline for financial document QA. Stage 1 performs finance-aware hybrid retrieval over text and tables. Stage 2 decomposes answers into atomic claims classified by a six-type financial taxonomy and verified with type-routed strategies including formula reconstruction. Stage 3 rewrites unsupported claims with paragraph- and table-cell-level citations. To cleanly isolate verification value from retrieval quality, we propose retrieval-equalized evaluation as standard methodology for RAG verification research: when all systems receive identical retrieval, FinGround still reduces hallucination rates by 68% over the strongest baseline ($p < 0.01$). The full pipeline achieves a 78% reduction relative to GPT-4o. An 8B distilled detector retains 91.4% F1 at 18x lower per-claim latency, enabling $0.003/query deployment, supported by qualitative signals from a four-week analyst pilot.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。