arXiv:2504.14493cs.IRcs.AI2025-04中稿 · the 34th ACM Inter…被引 31

用多维度检索增强生成,提升金融文件合规问答准确率。

FinSage: A Multi-aspect RAG System for Financial Filings Question Answering

  • 构建多模态预处理与混合检索机制,统一文本、表格等异构数据
  • 在金融文档问答上实现92.51%召回率,比最优基线高24.06%准确率
  • 专为合规场景设计,适合金融风控与审计人员使用

在金融领域,企业日益依赖检索增强生成(RAG)系统应对复杂的合规要求。然而,现有方案难以处理金融文件中多模态数据(如文本、表格、图表)的异质性以及监管标准的动态变化,导致关键信息提取准确率下降。本文提出FinSage框架,采用多维度RAG架构,针对多模态金融文档的合规分析进行优化。其核心包含三个创新组件:(1)多模态预处理流水线,统一异构数据并生成块级元数据摘要;(2)融合查询扩展(HyDE)与元数据感知语义搜索的多路径稀疏-稠密检索;(3)基于直接偏好优化(DPO)微调的领域专用重排序模块,优先输出合规关键内容。实验表明,FinSage在75个专家标注问题上达到92.51%的召回率,在FinanceBench问答数据集上比最优基线高出24.06%准确率。该系统已成功部署于线上会议中的金融问答代理,服务超过1,200人次。

原文摘要 · Abstract (English)

Leveraging large language models in real-world settings often entails a need to utilize domain-specific data and tools in order to follow the complex regulations that need to be followed for acceptable use. Within financial sectors, modern enterprises increasingly rely on Retrieval-Augmented Generation (RAG) systems to address complex compliance requirements in financial document workflows. However, existing solutions struggle to account for the inherent heterogeneity of data (e.g., text, tables, diagrams) and evolving nature of regulatory standards used in financial filings, leading to compromised accuracy in critical information extraction. We propose the FinSage framework as a solution, utilizing a multi-aspect RAG framework tailored for regulatory compliance analysis in multi-modal financial documents. FinSage introduces three innovative components: (1) a multi-modal pre-processing pipeline that unifies diverse data formats and generates chunk-level metadata summaries, (2) a multi-path sparse-dense retrieval system augmented with query expansion (HyDE) and metadata-aware semantic search, and (3) a domain-specialized re-ranking module fine-tuned via Direct Preference Optimization (DPO) to prioritize compliance-critical content. Extensive experiments demonstrate that FinSage achieves an impressive recall of 92.51% on 75 expert-curated questions derived from surpasses the best baseline method on the FinanceBench question answering datasets by 24.06% in accuracy. Moreover, FinSage has been successfully deployed as financial question-answering agent in online meetings, where it has already served more than 1,200 people.

金融AIRAG多模态合规检测

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。