arXiv:2511.07405cs.CLcs.CY2025-11

构建首个法语在线对话关键干预检测数据集,助力识别微妙停顿言论。

SPOT: An Annotated French Corpus and Benchmark for Detecting Critical Interventions in Online Conversations

  • 将社会学中的'停顿点'概念转化为可复现的二分类任务
  • 4.3万条法语评论标注,编码器模型F1达0.78,优于提示大模型10个百分点
  • 适合关注非英语社交话语分析、虚假信息治理的研究者

我们提出SPOT(Online Threads中的停顿点),首个将社会学中的'停顿点'概念转化为可复现自然语言处理任务的标注语料库。停顿点是通过反讽、微妙质疑或片段化论证等形式暂停或转向在线讨论的普通关键干预,常被反言辞或社会矫正框架忽视。我们将该概念操作化为二分类任务,并提供可靠标注指南。语料库包含43,305条人工标注的法语Facebook评论,关联社交媒体用户标记为虚假信息的链接,附带上下文元数据(文章、帖子、父评论、页面或群组、来源)。我们对微调的编码器模型(CamemBERT)和指令微调的大语言模型在不同提示策略下进行基准测试。结果表明,微调编码器在F1分数上比提示大模型高出超过10个百分点,证实了监督学习对新兴非英语社交媒体任务的重要性。引入上下文元数据后,编码器模型的F1得分从0.75提升至0.78。我们已发布匿名化数据集,以及标注指南和代码,以促进透明与可复现研究。

原文摘要 · Abstract (English)

We introduce SPOT (Stopping Points in Online Threads), the first annotated corpus translating the sociological concept of stopping point into a reproducible NLP task. Stopping points are ordinary critical interventions that pause or redirect online discussions through a range of forms (irony, subtle doubt or fragmentary arguments) that frameworks like counterspeech or social correction often overlook. We operationalize this concept as a binary classification task and provide reliable annotation guidelines. The corpus contains 43,305 manually annotated French Facebook comments linked to URLs flagged as false information by social media users, enriched with contextual metadata (article, post, parent comment, page or group, and source). We benchmark fine-tuned encoder models (CamemBERT) and instruction-tuned LLMs under various prompting strategies. Results show that fine-tuned encoders outperform prompted LLMs in F1 score by more than 10 percentage points, confirming the importance of supervised learning for emerging non-English social media tasks. Incorporating contextual metadata further improves encoder models F1 scores from 0.75 to 0.78. We release the anonymized dataset, along with the annotation guidelines and code in our code repository, to foster transparency and reproducible research.

社交话语法语NLP虚假信息多模态标注

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。