arXiv:2511.06292cs.AI2025-11被引 1

用合成数据自动优化金融问答提示,无需人工标注。

Synthetic Data-Driven Prompt Tuning for Financial QA over Tables and Documents

  • 通过生成合成财务表格和文档片段,发现提示缺陷并迭代优化。
  • 在DocMath-Eval上准确率和鲁棒性均优于传统提示方法。
  • 适合需要快速适配新财务文档的智能分析系统开发者。

财务文档如财报或资产负债表常包含长表格和多页报告。大语言模型已成为辅助数值推理与理解这些文档的新工具。然而,提示质量对LLM在金融推理任务中的表现有显著影响。现有方法通常在固定财务文本或表格数据集上微调提示,难以适应新问题类型或文档结构,且依赖昂贵的人工标注/整理数据集。本文提出一种由数据增强优化驱动的自提升提示框架。该闭环流程中,我们生成合成财务表格和文档片段,验证其正确性与鲁棒性,并据此更新提示。具体而言,框架结合合成数据生成器、验证器与提示优化器:生成器创建暴露当前提示弱点的新样例,验证器评估样例的有效性与鲁棒性,优化器则根据结果逐步改进提示。通过反馈循环迭代,本方法在无需外部标签的情况下持续提升提示在金融推理任务中的准确性。在DocMath-Eval基准上的评估显示,系统在准确率与鲁棒性上均优于标准提示方法,凸显了将合成数据生成融入金融领域提示学习的价值。

原文摘要 · Abstract (English)

Financial documents like earning reports or balance sheets often involve long tables and multi-page reports. Large language models have become a new tool to help numerical reasoning and understanding these documents. However, prompt quality can have a major effect on how well LLMs perform these financial reasoning tasks. Most current methods tune prompts on fixed datasets of financial text or tabular data, which limits their ability to adapt to new question types or document structures, or they involve costly and manually labeled/curated dataset to help build the prompts. We introduce a self-improving prompt framework driven by data-augmented optimization. In this closed-loop process, we generate synthetic financial tables and document excerpts, verify their correctness and robustness, and then update the prompt based on the results. Specifically, our framework combines a synthetic data generator with verifiers and a prompt optimizer, where the generator produces new examples that exposes weaknesses in the current prompt, the verifiers check the validity and robustness of the produced examples, and the optimizer incrementally refines the prompt in response. By iterating these steps in a feedback cycle, our method steadily improves prompt accuracy on financial reasoning tasks without needing external labels. Evaluation on DocMath-Eval benchmark demonstrates that our system achieves higher performance in both accuracy and robustness than standard prompt methods, underscoring the value of incorporating synthetic data generation into prompt learning for financial applications.

金融AI提示工程合成数据自然语言推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。