用AI自动评估气候新闻科学准确性,助力公众识别虚假信息。
Computational Fact-Checking of Online Discourse: Scoring scientific accuracy in climate change related news articles
- 通过大模型提取新闻语句,与知识图谱比对验证真伪。
- 专家与用户测试显示工具能有效提供可信度评分。
- 适合关注气候议题的媒体从业者和政策制定者使用。
民主社会需要可靠信息。流行媒体中的错误信息,如新闻文章或视频,可能损害公共讨论。然而,公众难以每日快速验证海量内容。本文旨在半自动量化在线媒体的科学准确性。研究了气候相关事实知识表示的最新进展,通过语义化处理未知真实性内容,将其陈述与真实知识图谱进行比对。我们实现了基于大模型的陈述抽取与知识图谱分析工作流,可提升内容处理效率并实现先进知识表示下的可信度量化。该工具经27位专家及10次深度访谈验证,获得积极反馈;43名匿名参与者调查也支持其有效性。但当前方法尚无法在所需粒度和规模上标注公开媒体内容。此外,现有气候知识图谱仍远不充分,难以支撑此类神经符号式事实核查。未来需构建符合FAIR(可发现、可访问、可互操作、可重用)标准的真实知识库及补充指标,以科学支持公共讨论。
原文摘要 · Abstract (English)
Democratic societies need reliable information. Misinformation in popular media, such as news articles or videos, threatens to impair civic discourse. Citizens are, unfortunately, not equipped to verify the flood of content consumed daily at increasing rates. This work aims to quantify the scientific accuracy of online media semi-automatically. We investigate the state of the art of climate-related ground truth knowledge representation. By semantifying media content of unknown veracity, their statements can be compared against these ground truth knowledge graphs. We implemented a workflow using LLM-based statement extraction and knowledge graph analysis. Our implementation can streamline content processing towards state-of-the-art knowledge representation and veracity quantification. Developed and evaluated with the help of 27 experts and detailed interviews with 10, the tool evidently provides a beneficial veracity indication. These findings are supported by 43 anonymous participants from a parallel user survey. This initial step, however, is unable to annotate public media at the required granularity and scale. Additionally, the identified state of climate change knowledge graphs is vastly insufficient to support this neurosymbolic fact-checking approach. Further work towards a FAIR (Findable, Accessible, Interoperable, Reusable) ground truth and complementary metrics is required to support civic discourse scientifically.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。