arXiv:2507.01991q-fin.CPcs.CL2025-07

用Transformer模型精准识别财报中每句话的AI披露内容

FinAI-BERT: A Transformer-Based Model for Sentence-Level Detection of AI Disclosures in Financial Reports

  • 基于领域适配的BERT模型,实现句子级AI披露分类
  • 在1586句财报数据上准确率达99.37%,F1值0.993
  • 可解释性强,适合监管、分析人员追踪金融机构AI应用

人工智能在金融领域的广泛应用,催生了对系统化检测企业文件中AI披露内容工具的需求。现有方法多依赖关键词扩展或文档级分类,存在粒度粗、可解释性差、鲁棒性不足等问题。本文提出FinAI-BERT,一种面向金融文本的领域适配型Transformer语言模型,用于对财务报告中的句子进行AI相关内容的细粒度分类。模型在从669家美国银行2015至2023年年报中人工标注并平衡的1,586个句子上微调,取得了接近完美的分类性能(准确率99.37%,F1值0.993),显著优于逻辑回归、朴素贝叶斯、随机森林和XGBoost等传统基线模型。通过SHAP进行词元归因分析确保可解释性,且经偏见分析与鲁棒性测试验证,在不同句长、对抗样本及时间样本下均表现稳定。理论层面,推动了金融NLP中基于Transformer架构的细粒度主题分类;实践层面,为分析师、监管机构与学者提供了一种可扩展、透明的工具,用于监测金融机构中AI技术的传播与表述方式。

原文摘要 · Abstract (English)

The proliferation of artificial intelligence (AI) in financial services has prompted growing demand for tools that can systematically detect AI-related disclosures in corporate filings. While prior approaches often rely on keyword expansion or document-level classification, they fall short in granularity, interpretability, and robustness. This study introduces FinAI-BERT, a domain-adapted transformer-based language model designed to classify AI-related content at the sentence level within financial texts. The model was fine-tuned on a manually curated and balanced dataset of 1,586 sentences drawn from 669 annual reports of U.S. banks (2015 to 2023). FinAI-BERT achieved near-perfect classification performance (accuracy of 99.37 percent, F1 score of 0.993), outperforming traditional baselines such as Logistic Regression, Naive Bayes, Random Forest, and XGBoost. Interpretability was ensured through SHAP-based token attribution, while bias analysis and robustness checks confirmed the model's stability across sentence lengths, adversarial inputs, and temporal samples. Theoretically, the study advances financial NLP by operationalizing fine-grained, theme-specific classification using transformer architectures. Practically, it offers a scalable, transparent solution for analysts, regulators, and scholars seeking to monitor the diffusion and framing of AI across financial institutions.

金融NLPAI披露Transformer句子分类

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。