arXiv:2410.15551cs.CL2024-10NAACL被引 3

提出跨领域对话治理分析框架,揭示不同场景下管理员策略差异。

WHoW: A Cross-domain Approach for Analysing Conversation Moderation

  • 从动机、行为、对象三维度构建跨领域分析框架
  • 基于5657条人工标注与15494条GPT-4o标注数据验证有效性
  • 适用于电视辩论与电台访谈,助力智能管理员开发

我们提出WHoW,一个用于分析不同领域/场景中管理员促进策略的评估框架,通过考察其动机(Why)、对话行为(How)和目标说话人(Who)。利用该框架,我们在两个领域(电视辩论与电台访谈)中分别进行了5,657条人工标注和15,494条GPT-4o自动标注。对比分析表明该框架具有跨领域泛化能力,并揭示出显著差异:辩论类主持人更注重协调与通过提问和指令推动互动,而访谈类主持人则更侧重信息传递并主动参与讨论。该分析框架适用于多种管理场景,通过自动化大规模分析提升了对管理行为的理解,有助于推动管理员代理的发展。

原文摘要 · Abstract (English)

We propose WHoW, an evaluation framework for analyzing the facilitation strategies of moderators across different domains/scenarios by examining their motives (Why), dialogue acts (How) and target speaker (Who). Using this framework, we annotated 5,657 moderation sentences with human judges and 15,494 sentences with GPT-4o from two domains: TV debates and radio panel discussions. Comparative analysis demonstrates the framework's cross-domain generalisability and reveals distinct moderation strategies: debate moderators emphasise coordination and facilitate interaction through questions and instructions, while panel discussion moderators prioritize information provision and actively participate in discussions. Our analytical framework works for different moderation scenarios, enhances our understanding of moderation behaviour through automatic large-scale analysis, and facilitates the development of moderator agents.

对话治理跨领域数据分析智能代理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。