人们评价AI逻辑推理能力时存在认知偏见。
A perceptual bias of AI Logical Argumentation Ability in Writing
- 通过对比人写与AI生成文本，测试评估偏差
- 对AI逻辑能力的评价受先入为主观念影响显著
- 常使用AI者更不信其会削弱独立思考
机器能否思考？这是人工智能研究的核心问题。然而，人们对这一问题的答案存在巨大分歧。为何人们在观察同一AI表现时仍意见相左？逻辑推理能力常被视为判断机器是否能思考的关键标准。本研究探讨人类偏见是否影响对AI推理能力的评估。实验让参与者评判同一主题的两篇文本——一篇由人类撰写，一篇由AI生成，以检测对逻辑推理能力评估中的感知偏差。基于实验结果，设计问卷量化人们对AI的态度。结果显示存在明显感知偏差：对AI逻辑推理能力的评价显著受到个人预设观念的影响。此外，频繁使用AI的人更少认为使用AI会削弱独立思考能力。研究强调需正视感知偏差，以提升公众对AI能力的理解，促进更良性的互动。
原文摘要 · Abstract (English)
Can machines think? This is a central question in artificial intelligence research. However, there is a substantial divergence of views on the answer to this question. Why do people have such significant differences of opinion, even when they are observing the same real world performance of artificial intelligence? The ability of logical reasoning like humans is often used as a criterion to assess whether a machine can think. This study explores whether human biases influence evaluations of the reasoning abilities of AI. An experiment was conducted where participants assessed two texts on the same topic, one AI generated and one human written,to test for perceptual biases in evaluating logical reasoning. Based on the experimental findings, a questionnaire was designed to quantify the attitudes toward AI.The results reveal a bias in perception. The evaluations of the logical reasoning ability of AI generated texts are significantly influenced by the preconceived views on the logical reasoning abilities of AI. Furthermore, frequent AI users were less likely to believe that AI usage undermines independent thinking.This study highlights the need to address perceptual biases to improve public understanding of AI's capabilities and foster better human AI interactions.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。