arXiv:2504.10768cs.CLcs.AI2025-04被引 4

用大模型分析演讲开头片段,10%内容就能预测整体质量。

The Art of Audience Engagement: LLM-Based Thin-Slicing of Scientific Talks

  • 用大模型评估演讲短片段,比对人类评分验证有效性
  • 不到10%的开头内容即可准确预测整体演讲质量
  • 适合想提升公众演讲能力的研究者与教育工作者

本文研究科学演讲中的'薄切片'现象——基于极少信息做出准确判断的能力。基于非语言沟通与人格心理学研究,我们发现简短片段能可靠预测整体演讲质量。利用超过一百场真实科学演讲构成的新语料库,采用大语言模型(LLMs)评估完整演讲及其薄切片。通过对比模型对短片段与完整演讲的评分,确定准确预测所需的信息量。结果表明,大模型评分与人工评分高度一致,证明其有效性、可靠性与高效性。关键发现:即使极短片段(少于演讲总时长10%)也强烈预测整体评价,说明开场几秒传递的关键信息影响整体印象形成。该结论在不同大模型和提示策略下均稳健。本研究将薄切片理论拓展至公共演讲领域,连接印象形成理论与大模型及人工智能传播研究。最后提出一个可扩展的大模型薄切片框架,可用于提升人类沟通能力的反馈工具。

原文摘要 · Abstract (English)

This paper examines the thin-slicing approach - the ability to make accurate judgments based on minimal information - in the context of scientific presentations. Drawing on research from nonverbal communication and personality psychology, we show that brief excerpts (thin slices) reliably predict overall presentation quality. Using a novel corpus of over one hundred real-life science talks, we employ Large Language Models (LLMs) to evaluate transcripts of full presentations and their thin slices. By correlating LLM-based evaluations of short excerpts with full-talk assessments, we determine how much information is needed for accurate predictions. Our results demonstrate that LLM-based evaluations align closely with human ratings, proving their validity, reliability, and efficiency. Critically, even very short excerpts (less than 10 percent of a talk) strongly predict overall evaluations. This suggests that the first moments of a presentation convey relevant information that is used in quality evaluations and can shape lasting impressions. The findings are robust across different LLMs and prompting strategies. This work extends thin-slicing research to public speaking and connects theories of impression formation to LLMs and current research on AI communication. We discuss implications for communication and social cognition research on message reception. Lastly, we suggest an LLM-based thin-slicing framework as a scalable feedback tool to enhance human communication.

大模型应用演讲分析心理认知人机交互

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。