arXiv:2505.08143cs.HCcs.AI2025-05被引 2

对比AI与人类撰写新冠谣言辟谣内容,发现人更爱读AI的,但AI不够有说服力。

Communication styles and reader preferences of LLM- and human-authored COVID-19 information explanations: a case study

  • 用健康传播理论分析谣言解释的语体、说服策略和价值契合度
  • 60%以上读者偏好AI生成内容,因其结构清晰、语气中立
  • 尽管读者偏爱AI,但其说服力和价值观契合度明显低于人工内容

随着大语言模型在信息辅助中的广泛应用,评估其与人类沟通风格和价值观的一致性至关重要。本研究聚焦于健康事实核查领域,基于1498条权威机构发布的健康谣言及解释,生成对应的大语言模型响应。结合健康传播理论,从语言特征、说服策略和受众价值契合度三个维度评估沟通风格,并通过99名参与者盲评测试读者感知。结果表明,模型生成内容在说服策略、确定性表达及社会价值契合度方面显著低于人工内容;但超过60%的参与者更偏好模型生成的文章,认为其更具清晰性、完整性和说服力。这一偏好可能源于结构化呈现、表达清晰和中立语气所传递的专业感,尽管牺牲了部分语义深度与严谨性。研究揭示了大语言模型在健康传播中的潜力与局限,提示读者偏好未必反映沟通质量的优劣。

原文摘要 · Abstract (English)

With the wide adoption of large language models (LLMs) in information assistance, it is essential to examine their alignment with human communication styles and values. We situate this study within health fact-checking, where effective communication is critical for correcting misconceptions and building trust. Although recent studies have explored LLMs for fact-checking and health communication, differences between LLM and human communication styles and associated reader perceptions remain under-explored. We compiled a dataset of 1,498 health misinformation claims and explanations from authoritative fact-checking organizations and generated LLM responses to inaccurate health information. Drawing on health communication theories, we evaluated communication styles across three dimensions: information linguistic features, sender persuasive strategies, and receiver value alignments. We further assessed reader perceptions through a blinded evaluation with 99 participants. LLM-generated articles scored significantly lower in persuasive strategies, certainty expressions, and alignment with social values and moral foundations. However, participants strongly preferred LLM content, with over 60% of responses favoring LLM articles for clarity, completeness, and persuasiveness. This preference was associated with structured presentation, clarity, and neutral tone, which may convey completeness and professionalism despite reduced nuance or rigor. These findings highlight both the potential and limitations of LLMs in health communication and fact-checking, suggesting that reader preference may not necessarily correspond to established measures of communication quality.

大模型健康传播读者偏好

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。