arXiv:2603.13154cs.CLcs.AI2026-03AAAI被引 1

构建首个用于检测大模型幻觉的ESG报告基准数据集

ESG-Bench: Benchmarking Long-Context ESG Reports for Hallucination Mitigation

  • 用真实企业报告构建带事实标签的问答对,支持可验证分析
  • 结合思维链提示与微调,使模型幻觉率显著降低
  • 适用于合规、可持续性等高敏感度场景的可信分析

随着环境、社会和治理(ESG)标准在企业责任中日益重要,许多地区已将ESG报告列为法定要求,成为记录可持续实践和评估企业长期伦理表现的关键渠道。然而,ESG披露内容冗长复杂,难以解读且自动化分析可靠性不足。为此,本文提出ESG-Bench,一个面向大语言模型(LLMs)在长文本中理解与幻觉抑制的基准数据集。该数据集包含基于真实企业报告的人工标注问答对,并带有细粒度标签,明确标识模型输出是否符合事实。将ESG分析任务定义为具有可验证性的问答任务,可系统评估模型提取与推理能力,并为高敏感性、合规关键场景中的幻觉抑制提供新范式。我们设计了特定任务的思维链(CoT)提示策略,并利用标注的推理链对多个先进大模型进行微调。实验表明,基于思维链的方法在减少幻觉方面显著优于标准提示和直接微调,且性能提升可迁移至其他通用问答基准。

原文摘要 · Abstract (English)

As corporate responsibility increasingly incorporates environmental, social, and governance (ESG) criteria, ESG reporting is becoming a legal requirement in many regions and a key channel for documenting sustainability practices and assessing firms' long-term and ethical performance. However, the length and complexity of ESG disclosures make them difficult to interpret and automate the analysis reliably. To support scalable and trustworthy analysis, this paper introduces ESG-Bench, a benchmark dataset for ESG report understanding and hallucination mitigation in large language models (LLMs). ESG-Bench contains human-annotated question-answer (QA) pairs grounded in real-world ESG report contexts, with fine-grained labels indicating whether model outputs are factually supported or hallucinated. Framing ESG report analysis as a QA task with verifiability constraints enables systematic evaluation of LLMs' ability to extract and reason over ESG content and provides a new use case: mitigating hallucinations in socially sensitive, compliance-critical settings. We design task-specific Chain-of-Thought (CoT) prompting strategies and fine-tune multiple state-of-the-art LLMs on ESG-Bench using CoT-annotated rationales. Our experiments show that these CoT-based methods substantially outperform standard prompting and direct fine-tuning in reducing hallucinations, and that the gains transfer to existing QA benchmarks beyond the ESG domain.

ESG报告幻觉抑制大模型评测思维链

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。