低质量AI不披露性能，反而误导人识谎，揭露真相后效果才恢复
The Good, the Bad, and the Ugly: The Role of AI Quality Disclosure in Lie Detection
- 用无披露的劣质AI辅助识谎，反而降低人类判断准确率
- 一旦揭示AI真实表现，人类识谎能力立即回升至原有水平
- 人们因误判AI能力而盲目信赖，适合关注AI可信度的研究者
我们研究了缺乏质量披露的低质量AI助手如何在文本识谎任务中误导用户。实验中，参与者需评估模拟社交媒体欺骗行为的游戏节目对话转录稿，这些话题具有客观真相。结果显示，当依赖无披露的低质量助手时，参与者的识谎准确率低于其自身能力；而一旦知晓AI的真实表现，准确率迅速恢复。相反，高质量助手无论是否披露，均能提升识谎效果。研究发现，人们对AI能力的错误预期是导致过度依赖不透明低质助手的关键原因。
原文摘要 · Abstract (English)
We investigate how low-quality AI advisors, lacking quality disclosures, can help spread text-based lies while seeming to help people detect lies. Participants in our experiment discern truth from lies by evaluating transcripts from a game show that mimicked deceptive social media exchanges on topics with objective truths. We find that when relying on low-quality advisors without disclosures, participants' truth-detection rates fall below their own abilities, which recovered once the AI's true effectiveness was revealed. Conversely, high-quality advisor enhances truth detection, regardless of disclosure. We discover that participants' expectations about AI capabilities contribute to their undue reliance on opaque, low-quality advisors.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。