arXiv:2410.21360cs.CL2024-10中稿 · ACM Transactions o…综述被引 9

系统梳理大模型时代文本可信度评估的九类信号与方法

A Survey on Automatic Credibility Assessment Using Textual Credibility Signals in the Era of Large Language Models

  • 归纳175篇论文,整合文本可信度信号检测框架
  • 聚焦事实性、说服技巧、可验证声明三类核心信号
  • 适合关注AI虚假信息治理的研究者与从业者

在社交媒体与生成式AI盛行的时代,自动评估网络内容可信度愈发关键,需融合多种可信度信号——如内容主观性、偏见或说服技巧等小粒度信息——形成最终可信度标签或评分。然而当前研究高度碎片化,多数信号孤立研究,缺乏多信号协同检测与整合。尤其缺少同时识别并聚合多种可信度信号的方法。这一问题因缺乏对相关研究的系统性综述而加剧,难以揭示共性趋势、挑战与开放问题。本文通过系统回顾175篇自然语言处理领域论文,聚焦大模型推动下的文本可信度信号研究,涵盖九类信号,并深入分析其中三大核心类别:1)事实性、主观性与偏见;2)说服技巧与逻辑谬误;3)可核查与已验证声明。在总结现有方法、数据集与工具基础上,提出未来研究方向,特别关注生成式AI带来的新挑战。

原文摘要 · Abstract (English)

In the age of social media and generative AI, the ability to automatically assess the credibility of online content has become increasingly critical, complementing traditional approaches to false information detection. Credibility assessment relies on aggregating diverse credibility signals - small units of information, such as content subjectivity, bias, or a presence of persuasion techniques - into a final credibility label/score. However, current research in automatic credibility assessment and credibility signals detection remains highly fragmented, with many signals studied in isolation and lacking integration. Notably, there is a scarcity of approaches that detect and aggregate multiple credibility signals simultaneously. These challenges are further exacerbated by the absence of a comprehensive and up-to-date overview of research works that connects these research efforts under a common framework and identifies shared trends, challenges, and open problems. In this survey, we address this gap by presenting a systematic and comprehensive literature review of 175 research papers, focusing on textual credibility signals within the field of Natural Language Processing (NLP), which undergoes a rapid transformation due to advancements in Large Language Models (LLMs). While positioning the NLP research into the the broader multidisciplinary landscape, we examine both automatic credibility assessment methods as well as the detection of nine categories of credibility signals. We provide an in-depth analysis of three key categories: 1) factuality, subjectivity and bias, 2) persuasion techniques and logical fallacies, and 3) check-worthy and fact-checked claims. In addition to summarising existing methods, datasets, and tools, we outline future research direction and emerging opportunities, with particular attention to evolving challenges posed by generative AI.

可信度评估大模型NLP虚假信息

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。