研究ChatGPT在伦理议题上的说服力，发现其论据虽通顺但难改变人立场。
How Persuasive Could LLMs Be? A First Study Combining Linguistic-Rhetorical Analysis and User Experiments
- 分析ChatGPT生成文本的修辞结构与语言特征
- 62人实验显示伦理观点变化不大甚至更坚定
- 适合关注AI说服力与伦理传播的研究者
本研究考察了ChatGPT在涉及伦理敏感话题时生成论证文本的语言与修辞特征，并通过包含62名参与者的用户实验及前后问卷调查，探究其对人类读者观点转变与认知感知的影响。对生成文本的语言与修辞分析显示，其具有稳定的论证宏观结构、依赖程式化表达且风格多样性不足。尽管ChatGPT能构建连贯的论证文本，但在涉及伦理议题时其说服效力受限。实验发现，参与者虽常认可其提及的优势，但伦理顾虑往往未消解，甚至在互动后增强。结果还显示说服效果随议题不同而异。该研究为理解人工智能在伦理敏感领域中的说服机制提供了新视角，也为后续研究奠定基础。
原文摘要 · Abstract (English)
This study examines the rhetorical and linguistic features of argumentative texts generated by ChatGPT on ethically nuanced topics and investigates their persuasive impact on human readers.Through a user study involving 62 participants and pre-post interaction surveys, the paper analyzes how exposure to AI-generated arguments affects opinion change and user perception. A linguistic and rhetorical analysis of the generated texts reveals a consistent argumentative macrostructure, reliance on formulaic expressions, and limited stylistic richness. While ChatGPT demonstrates proficiency in constructing coherent argumentative texts, its persuasive efficacy appears constrained, particularly on topics involving ethical issues.The study finds that while participants often acknowledge the benefits highlighted by ChatGPT, ethical concerns tend to persist or even intensify post-interaction. The results also demonstrate a variation depending on the topic. These findings highlight new insights on AI-generated persuasion in ethically sensitive domains and are a basis for future research.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。