对比人类与大模型在在线讨论中何时介入,发现后者过于激进。
To Facilitate or not to Facilitate: Human and LLM Facilitator Tendencies in Online Discussions
- 构建PEFK数据集,统一标准并分析干预时机
- 人类更谨慎,大模型却过度主动干预
- 用BERT微调可改善判断,但现有数据限制性能上限
自动化在线讨论引导是长期社会议题,尤其在内容审核失效、在线时间增长的背景下。尽管已有研究探讨如何引导,但尚未回答关键问题:何时应介入?大语言模型(LLM)可能提供大规模自动干预的可行性。本研究通过定义引导行为,观察人类引导时机,并对比其与大模型决策的差异。我们创建了PEFK——首个标准化聚合所有相关引导数据集的语料库,并首次开展关于引导时机的调查,使用专家引导者和大模型作为评判者。结果发现,人类更谨慎,而大模型则过于急切地发起引导;不过两者在判断‘无需引导’时均更确信。随后我们尝试通过不同提示设置和在现有数据集上训练ModernBert分类器来纠正此行为,发现后者的可靠性更高,但当前数据集设定导致性能天花板较低。
原文摘要 · Abstract (English)
Automating facilitation in online discussions is a long-standing social concern given the increasing time we spend on online spaces and the failure of content moderation approaches. While studies have been conducted on how to facilitate, none have answered the essential question of when to do so. A potential answer is using LLMs, which ostensibly make automated, large-scale intervention increasingly feasible. In this study, we examine when LLMs decide to facilitate by defining what facilitation is, observing when humans decide to facilitate, and comparing their decisions with those made by LLMs. To this end, we create PEFK, a corpus standardizing and aggregating all relevant facilitation datasets. We are the first to run a survey on facilitation timing, which we execute using expert facilitative participants and LLM-as-a-judge models. We discover that while humans are more cautious, LLMs are excessively eager to facilitate, although both are more certain when judging that facilitation is not needed. We then investigate whether this behavior can be corrected using alternative setups for LLMs and training ModernBert classifiers on established datasets, finding that the latter perform more reliably than the former, although current datasets impose a relatively low performance ceiling.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。