让大模型实时读取金融数据,自动回答最新行情问题。
FinBloom: Knowledge Grounding Large Language Model with Real-time Financial Data
- 用实时新闻和财报微调大模型,使其能理解金融上下文
- 基于1400万篇财经报道训练出70亿参数的金融专用模型
- 支持低延迟响应,适合高频交易等实时决策场景
大语言模型在生成类人回复方面表现优异,但在需要实时信息交互的任务中表现受限。在金融领域,模型需获取最新新闻或价格变动等信息以支持决策。为此,我们提出Financial Agent,一种将大模型与实时文本和表格数据结合的知识增强方法。贡献有三:首先,构建包含5万余条金融查询及其所需上下文的金融上下文数据集;其次,基于1400万篇路透社和德意志新闻社(DPA)的财经新闻,以及1200万份美国证券交易委员会(SEC)文件中随机抽取的25%,对Bloom 7B进行微调,得到定制化70亿参数模型FinBloom 7B;第三,利用金融上下文数据集进一步微调该模型,使其可自动生成相关金融上下文,实现高效实时数据检索以回答用户问题。该方法显著提升大模型处理动态金融任务的能力,降低延迟并免去用户手动提供数据的负担,适用于高时效性数据场景中的实时金融决策、算法交易等任务。
原文摘要 · Abstract (English)
Large language models (LLMs) excel at generating human-like responses but often struggle with interactive tasks that require access to real-time information. This limitation poses challenges in finance, where models must access up-to-date information, such as recent news or price movements, to support decision-making. To address this, we introduce Financial Agent, a knowledge-grounding approach for LLMs to handle financial queries using real-time text and tabular data. Our contributions are threefold: First, we develop a Financial Context Dataset of over 50,000 financial queries paired with the required context. Second, we develop FinBloom 7B, a custom 7 billion parameter LLM, by fine-tuning Bloom 7B on 14 million financial news articles from Reuters and Deutsche Presse-Agentur (DPA), alongside a random sample of 25% from 12 million Securities and Exchange Commission (SEC) filings. Third, we fine-tune FinBloom 7B using the Financial Context Dataset to serve as a Financial Agent. This agent generates relevant financial context, enabling efficient real-time data retrieval to answer user queries. By reducing latency and eliminating the need for users to manually provide accurate data, our approach significantly enhances the capability of LLMs to handle dynamic financial tasks. Our proposed approach makes real-time financial decisions, algorithmic trading and other related tasks streamlined, and is valuable in contexts with high-velocity data flows.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。