arXiv:2510.10828cs.IRcs.AI2025-10被引 4

VeritasFi提升金融问答系统对多模态数据的处理能力,兼顾通用与公司定制需求。

VeritasFi: An Adaptable, Multi-tiered RAG Framework for Multi-modal Financial Question Answering

  • 构建多模态预处理流程,统一处理文本、表格、图表等异构数据。
  • 采用三路并行检索机制,结合语义索引、实时工具调用与专家记忆库。
  • 两阶段训练重排序模型,先通用后定制,快速适配不同企业场景。

检索增强生成(RAG)在金融问答中日益重要,需从复杂的公开披露文件中获取准确且上下文相关的洞察。然而现有金融RAG系统面临两大挑战:(1)难以处理文本、表格、图表等异构数据格式;(2)在通用领域适用性与公司特定适应性之间难以平衡。为此,我们提出VeritasFi,一种创新的混合RAG框架,包含多模态预处理管道和先进的两阶段重排序训练策略。VeritasFi通过三项关键创新提升金融问答性能:(1)多模态预处理管道,将异构数据无缝转换为机器可读格式;(2)三路并行混合检索引擎,融合语义索引文档库的深度多路径检索、通过工具调用的实时数据获取,以及针对高频问题的专家标注记忆库,确保覆盖广度、准确性和效率;(3)文档重排序器的两阶段训练策略,首先使用匿名数据构建通用领域模型,随后快速微调至公司特定数据以支持针对性应用。通过集成上述设计,VeritasFi显著提升了金融RAG系统的适应性与鲁棒性,为通用与公司专属问答任务提供可扩展解决方案。代码已开源:https://github.com/simplew4y/VeritasFi.git。

原文摘要 · Abstract (English)

Retrieval-Augmented Generation (RAG) is becoming increasingly essential for Question Answering (QA) in the financial sector, where accurate and contextually grounded insights from complex public disclosures are crucial. However, existing financial RAG systems face two significant challenges: (1) they struggle to process heterogeneous data formats, such as text, tables, and figures; and (2) they encounter difficulties in balancing general-domain applicability with company-specific adaptation. To overcome these challenges, we present VeritasFi, an innovative hybrid RAG framework that incorporates a multi-modal preprocessing pipeline alongside a cutting-edge two-stage training strategy for its re-ranking component. VeritasFi enhances financial QA through three key innovations: (1) A multi-modal preprocessing pipeline that seamlessly transforms heterogeneous data into a coherent, machine-readable format. (2) A tripartite hybrid retrieval engine that operates in parallel, combining deep multi-path retrieval over a semantically indexed document corpus, real-time data acquisition through tool utilization, and an expert-curated memory bank for high-frequency questions, ensuring comprehensive scope, accuracy, and efficiency. (3) A two-stage training strategy for the document re-ranker, which initially constructs a general, domain-specific model using anonymized data, followed by rapid fine-tuning on company-specific data for targeted applications. By integrating our proposed designs, VeritasFi presents a groundbreaking framework that greatly enhances the adaptability and robustness of financial RAG systems, providing a scalable solution for both general-domain and company-specific QA tasks. Code accompanying this work is available at https://github.com/simplew4y/VeritasFi.git.

金融问答多模态RAG信息检索公司定制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。