arXiv:2502.21112cs.AIcs.CE2025-02被引 13

用合成数据微调大模型,提升金融文本中环境活动的识别准确率。

Optimizing Large Language Models for ESG Activity Detection in Financial Texts

  • 结合真实与合成数据微调大模型,增强对环境活动的识别能力。
  • 在1325条标注文本上,小模型性能超越部分大厂商闭源模型。
  • 适合关注可持续金融、合规检测的分析师与算法研究者。

将环境、社会和治理(ESG)因素融入企业决策是可持续金融的核心。然而,确保商业实践符合不断演变的监管框架仍具挑战性。通过AI自动评估可持续性报告与非财务披露是否契合具体ESG活动,可显著辅助该过程。但这一任务因通用大语言模型在特定领域表现有限,且高质量结构化数据稀缺而复杂。本文研究当前大模型识别环境活动文本的能力,并证明通过在原始与合成数据组合上微调,性能可大幅提升。为此,我们构建了ESG-Activities基准数据集,包含1,325个按欧盟ESG分类标准标注的文本片段。实验表明,微调后模型分类准确率显著提高,开放模型如Llama 7B和Gemma 7B在特定配置下优于部分大型专有解决方案。这些发现对金融分析师、政策制定者及致力于提升ESG透明度与合规性的自然语言处理研究者具有重要意义。

原文摘要 · Abstract (English)

The integration of Environmental, Social, and Governance (ESG) factors into corporate decision-making is a fundamental aspect of sustainable finance. However, ensuring that business practices align with evolving regulatory frameworks remains a persistent challenge. AI-driven solutions for automatically assessing the alignment of sustainability reports and non-financial disclosures with specific ESG activities could greatly support this process. Yet, this task remains complex due to the limitations of general-purpose Large Language Models (LLMs) in domain-specific contexts and the scarcity of structured, high-quality datasets. In this paper, we investigate the ability of current-generation LLMs to identify text related to environmental activities. Furthermore, we demonstrate that their performance can be significantly enhanced through fine-tuning on a combination of original and synthetically generated data. To this end, we introduce ESG-Activities, a benchmark dataset containing 1,325 labelled text segments classified according to the EU ESG taxonomy. Our experimental results show that fine-tuning on ESG-Activities significantly enhances classification accuracy, with open models such as Llama 7B and Gemma 7B outperforming large proprietary solutions in specific configurations. These findings have important implications for financial analysts, policymakers, and AI researchers seeking to enhance ESG transparency and compliance through advanced natural language processing techniques.

ESG检测大模型微调金融文本合成数据

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。