arXiv:2607.17627cs.HCcs.CL2026-07

探索不同修辞方式如何影响AI辅助信息判断的准确性与思考深度。

It Matters How You Say It: Exploring Rhetorical Patterns for AI-Assisted Information Evaluation

论文配图:It Matters How You Say It: Exploring Rhetorical Patterns for AI-Assisted Information Evaluation
图 1 · 摘自论文原文
  • 设计八种修辞模式测试AI回应对用户思考的影响。
  • 引导式解释显著提升准确率,对抗性情境也小幅改善表现。
  • 用户偏好框架重构,但认为解释性替代方案耗时过长。

以往关于AI辅助信息评估的研究多关注AI传递的内容,比较解释类型与格式,但响应通常采用指令式修辞,系统直接给出结论,用户被动接受。尽管近期辩论式交互显示能激发批判性思维而非盲目服从,但塑造AI回应的修辞模式及其如何引发反思、不确定或独立推理仍缺乏研究。为此,我们考察了八种被认为可引发深思的修辞模式:故意误导、解释性替代、支架式说明、触发不信任、信息扭曲、替代框架、苏格拉底式提问及一个预言者基线。通过一项包含98名参与者的被试内实验,在提示式事实验证任务中,我们发现支架式说明与最高准确率提升相关,并促进更深层次反思。令人意外的是,对抗性条件也带来适度准确率提升。参与者最偏好替代框架,最不喜欢解释性替代,主要因其感知时间成本过高。我们讨论了以多样化修辞风格设计对话代理的含义,以及用户表现、满意度与反思之间的权衡。

原文摘要 · Abstract (English)

Prior work on AI-assisted information evaluation has largely focused on what AI systems communicate, comparing explanation types and formats, with responses predominantly cast in directive rhetoric where the system delivers a verdict and the user passively accepts it. While debate-style interactions have recently shown promise in prompting critical evaluation over deference, the rhetorical patterns that structure AI responses and how they might induce reflection, uncertainty, or independent reasoning remain largely unexamined. To address this, we investigated eight rhetorical patterns known to induce contemplation: Intentional Misleading, Interpretive Alternative, Scaffold Explanation, Triggering Distrust, Information Distortion, Alternative Framing, Socratic Questioning, and an Oracle baseline. Through a within-subject study with n=98 participants on a hint-on-demand fact verification task, we observed preliminary evidence that Scaffold Explanation were associated with the highest accuracy gains, and encouraging deeper reflection. Surprisingly, the adversarial conditions also improved accuracy modestly. Participants preferred Alternative Framing most and Interpretive Alternative least, largely due to the latter's perceived time cost. We discuss the implications of designing conversational agents with varied rhetorical styles and the trade-offs among user performance, satisfaction, and contemplation.

AI评估修辞模式用户反思

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。