arXiv:2503.14828cs.CLcs.AI2025-03被引 34

2025年信息真实性验证竞赛,聚焦主观性识别、事实核查等四大挑战。

The CLEF-2025 CheckThat! Lab: Subjectivity, Fact-Checking, Claim Normalization, and Retrieval

  • 设计多任务评测框架,覆盖从语义理解到证据检索的全链条验证流程。
  • 新增主张标准化与数值类声明核查,提升跨语言事实比对能力。
  • 适合研究虚假信息检测、自然语言处理及多语言信息可信度评估者。

CheckThat! 实验室致力于推动应对网络虚假信息与操纵行为的创新技术发展,覆盖多种语言和平台。前五届主要聚焦信息验证流程中的核心任务,包括值得核查性判断、证据检索与配对、以及最终验证。自2023年起,实验室拓展至支持验证研究与决策的辅助性任务。2025年版本既回归核心验证任务,又引入新挑战:任务1为主观性识别(延续2024年工作),任务2为主张标准化,任务3针对数值类声明的事实核查,任务4探索科学网络话语处理。这些任务在文档与片段层面均提出具有挑战性的分类与检索问题,涵盖多语言场景。

原文摘要 · Abstract (English)

The CheckThat! lab aims to advance the development of innovative technologies designed to identify and counteract online disinformation and manipulation efforts across various languages and platforms. The first five editions focused on key tasks in the information verification pipeline, including check-worthiness, evidence retrieval and pairing, and verification. Since the 2023 edition, the lab has expanded its scope to address auxiliary tasks that support research and decision-making in verification. In the 2025 edition, the lab revisits core verification tasks while also considering auxiliary challenges. Task 1 focuses on the identification of subjectivity (a follow-up from CheckThat! 2024), Task 2 addresses claim normalization, Task 3 targets fact-checking numerical claims, and Task 4 explores scientific web discourse processing. These tasks present challenging classification and retrieval problems at both the document and span levels, including multilingual settings.

事实核查多语言信息验证文本分析

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。