通过数据驱动编译框架,解决金融问答中数值幻觉问题
Fighting Numerical Hallucinations via Data-centric Compilation for Online Financial QA

- 构建对抗性数据训练模型,提升对噪声的鲁棒性
- 生成可验证的执行程序,使数值推理过程透明可审计
- 适合高精度金融场景的在线问答系统部署
大型语言模型在在线金融问答(FinQA)领域取得显著进展,但其仍易产生数值推理幻觉,严重影响高风险金融应用的可靠性。尽管检索增强生成(RAG)被广泛用于将回答锚定于外部知识,却面临噪声敏感、计算脆弱和可审计性危机三大挑战。现有以模型为中心的方法仅优化检索器或生成器之一,难以协同解决上述问题。本文提出首个数据中心范式,设计数据中心推理编译器(DCRC),包含三个协同阶段:(1) 对抗性数据构造,生成含可控噪声的训练样本以培养鲁棒性;(2) 多阶段训练,构建具备显式证据审计与程序合成能力的数据中心结构化代理(DSA);(3) 编译-执行推理流程,由DSA将用户查询与检索文档转化为可验证、可执行的推理程序。该数据驱动框架从设计上保障数值推理的准确性。我们在标准离线基准上开展大量实验,并在真实在线金融问答系统中部署验证了本框架的有效性。
原文摘要 · Abstract (English)
Large Language Models (LLMs) have significantly advanced online data services, particularly in the domain of financial question answering (FinQA). However, such systems remain susceptible to numerical reasoning hallucinations, which critically undermine reliability in high-stakes financial applications. Although retrieval-augmented generation (RAG) has been widely adopted to ground responses in external knowledge, it introduces three persistent challenges: noise sensitivity, calculation fragility, and an auditability crisis. Existing model-centric approaches, which primarily focus on optimizing either the retriever or generator in isolation, still struggle to address these issues in an integrated manner. In this work, we pioneer a data-centric paradigm and propose a novel framework, the Data-centric Reasoning Compiler (DCRC). The framework operates through three cohesive phases: (1) adversarial data construction, which synthesizes training examples with controlled noise to teach robustness; (2) multi-stage training that cultivates a Data-centric Structuring Agent (DSA) capable of explicit evidence auditing and program synthesis; and (3) a compile-and-execute inference process, where the DSA transforms user queries and retrieved documents into verifiable, executable reasoning programs. This data-driven framework ensures faithful numerical reasoning by design. We conduct extensive experiments on established offline benchmarks and further validate our framework through deployment in a real-world online financial QA system.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。