arXiv:2509.19833cs.CLcs.AI2025-09

检测新闻中可持续发展目标的正负面情绪,助力可持续发展监测。

Polarity Detection of Sustainable Development Goals in News Text

  • 提出SDG极性检测新任务,构建含人工与合成数据的基准集。
  • 微调后模型在SDG-9、12、15上表现最佳,准确率超基线。
  • 合成数据增强有效提升模型鲁棒性,适合政策分析与环境监控者。

联合国可持续发展目标(SDGs)为应对重大社会、环境与经济挑战提供了全球公认框架。尽管自然语言处理与大语言模型(LLMs)已能自动识别相关文本,却无法判断事件是推动还是阻碍目标实现。为此,本文提出全新的SDG极性检测任务,并构建了包含人工标注与合成样本的基准数据集SDG-POD。评估六种主流开源大模型在零样本与微调设置下的表现,研究合成数据增强的影响。结果表明,当前模型在该任务上仍具挑战性;但经微调后,尤其是QWQ-32B模型,在SDG-9、SDG-12和SDG-15上取得最优性能。同时,合成数据显著提升了模型鲁棒性与分类效果。本工作建立了新的评估基准,为可持续发展监测系统开发提供实践指导。

原文摘要 · Abstract (English)

The United Nations' Sustainable Development Goals (SDGs) provide a globally recognised framework for addressing major societal, environmental, and economic challenges. While recent advances in natural language processing (NLP) and large language models (LLMs) have enabled the automatic identification of SDG-related content, they do not capture whether the described events represent progress toward or regression from a specific goal. To address this gap, we introduce the novel task of SDG polarity detection and present SDG-POD, a benchmark dataset combining manually annotated and synthetically generated examples. We evaluate six state-of-the-art open-source LLMs under both zero-shot and fine-tuning settings and investigate the impact of synthetic data augmentation on model performance. Our results show that SDG polarity detection remains challenging for current LLMs; however, fine-tuned models, particularly QWQ-32B, achieve the best overall performance, with especially strong results on SDG-9, SDG-12, and SDG-15. Furthermore, we demonstrate that synthetic training data consistently improves model robustness and classification performance. This work introduces a new benchmark for SDG polarity detection and provides practical insights into developing LLM-based systems for sustainability monitoring.

可持续发展极性检测大模型文本分析

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。