用旧报告中的披露索引构建数据集,提升ESG报告检索效果
Enhancing Retrieval for ESGLLM via ESG-CID -- A Disclosure Content Index Finetuning Dataset for Mapping GRI and ESRS
- 利用历史报告的披露索引生成标注数据,解决检索训练数据不足问题
- 微调BERT模型在跨标准检索任务中超越商用和主流公开模型
- 适合关注ESG自动化、可持续报告与信息检索的研究者
气候变化加剧了组织实践透明度与问责制的需求,环境、社会与治理(ESG)报告日益重要。全球报告倡议组织(GRI)和欧洲可持续报告标准(ESRS)旨在规范ESG报告,但因文档长度长、企业风格差异大,生成全面报告仍具挑战。为推进ESG报告自动化,可采用检索增强生成(RAG)系统,但其发展受限于缺乏适用于检索模型训练的标注数据。本文利用未被充分利用的弱监督信号——过往报告中的披露内容索引(Disclosure Content Index),构建了面向GRI与ESRS标准的综合性数据集ESG-CID。通过提取具体披露要求与对应报告章节的映射关系,并使用大语言模型作为评判器进行优化,生成高质量训练与评估集。我们在该数据集上对主流嵌入模型进行基准测试,结果表明:微调基于BERT的模型在跨报告风格迁移(从GRI到ESRS)的时序数据划分下,仍能超越商业嵌入与领先公开模型。数据已开源:https://huggingface.co/datasets/airefinery/esg_cid_retrieval
原文摘要 · Abstract (English)
Climate change has intensified the need for transparency and accountability in organizational practices, making Environmental, Social, and Governance (ESG) reporting increasingly crucial. Frameworks like the Global Reporting Initiative (GRI) and the new European Sustainability Reporting Standards (ESRS) aim to standardize ESG reporting, yet generating comprehensive reports remains challenging due to the considerable length of ESG documents and variability in company reporting styles. To facilitate ESG report automation, Retrieval-Augmented Generation (RAG) systems can be employed, but their development is hindered by a lack of labeled data suitable for training retrieval models. In this paper, we leverage an underutilized source of weak supervision -- the disclosure content index found in past ESG reports -- to create a comprehensive dataset, ESG-CID, for both GRI and ESRS standards. By extracting mappings between specific disclosure requirements and corresponding report sections, and refining them using a Large Language Model as a judge, we generate a robust training and evaluation set. We benchmark popular embedding models on this dataset and show that fine-tuning BERT-based models can outperform commercial embeddings and leading public models, even under temporal data splits for cross-report style transfer from GRI to ESRS. Data: https://huggingface.co/datasets/airefinery/esg_cid_retrieval
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。