用金融领域优化的模型提升年报文本分析效果
FinTextSim: Enhancing Financial Text Analysis with BERTopic
- 用FinTextSim微调句向量模型,增强金融文本语义表达
- 搭配FinTextSim后,主题聚类内相似度提升81%,跨主题相似度降低100%
- 适合关注财报分析、投资决策和量化模型的研究者与从业者
近年来,信息可得性与计算能力的进步推动了年度报告分析的变革,将传统财务指标与文本数据洞察相结合。为从海量文本中提取价值,自动化方法如主题建模至关重要。本研究评估了基于上下文嵌入的前沿主题模型BERTopic在标普500公司2016-2022年10-K文件的Item 7与Item 7A中的表现。我们提出FinTextSim,一个针对金融场景优化的微调句向量模型,用于聚类与语义搜索。相比广泛使用的all-MiniLM-L6-v2,FinTextSim使主题内相似度提升81%,主题间相似度降低100%,显著提升组织清晰度。实验表明,仅当使用FinTextSim嵌入时,BERTopic才能形成清晰且独立的经济主题簇;否则存在严重误分类与主题重叠。因此,FinTextSim对推进金融文本分析至关重要。其增强的领域适配嵌入提升了未来研究与金融信息质量,助力利益相关方获得竞争优势,优化资源配置与决策流程,并可能改进企业估值与股价预测模型。
原文摘要 · Abstract (English)
Recent advancements in information availability and computational capabilities have transformed the analysis of annual reports, integrating traditional financial metrics with insights from textual data. To extract valuable insights from this wealth of textual data, automated review processes, such as topic modeling, are crucial. This study examines the effectiveness of BERTopic, a state-of-the-art topic model relying on contextual embeddings, for analyzing Item 7 and Item 7A of 10-K filings from S&P 500 companies (2016-2022). Moreover, we introduce FinTextSim, a finetuned sentence-transformer model optimized for clustering and semantic search in financial contexts. Compared to all-MiniLM-L6-v2, the most widely used sentence-transformer, FinTextSim increases intratopic similarity by 81% and reduces intertopic similarity by 100%, significantly enhancing organizational clarity. We assess BERTopic's performance using embeddings from both FinTextSim and all-MiniLM-L6-v2. Our findings reveal that BERTopic only forms clear and distinct economic topic clusters when paired with FinTextSim's embeddings. Without FinTextSim, BERTopic struggles with misclassification and overlapping topics. Thus, FinTextSim is pivotal for advancing financial text analysis. FinTextSim's enhanced contextual embeddings, tailored for the financial domain, elevate the quality of future research and financial information. This improved quality of financial information will enable stakeholders to gain a competitive advantage, streamlining resource allocation and decision-making processes. Moreover, the improved insights have the potential to leverage business valuation and stock price prediction models.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。