AI警告反而让人更信任,暴露透明度陷阱
The Transparency Trap: How AI Disclaimers Create Overconfidence in High-Stakes Decisions

- 测试不同位置和形式的警告,发现用户仍易轻信
- 医疗内容信任度最高,AI警告反被解读为诚实信号
- 适合关注AI可信度与设计伦理的研究者
当前的AI警告常因提醒疲劳和透明度悖论而失效。随着AI信息广泛用于金融、医疗及生成内容等高风险决策场景,有效风险沟通对负责任的设计至关重要。本探索性研究通过混合组内-组间实验设计,基于52名参与者对378个刺激样本的反馈,考察警告位置与说服性线索如何影响信任、感知准确性和警告参与度。结果显示,即使存在警告,用户仍普遍信任建议内容;医疗类内容的信任评分最高。在AI领域,出现透明度悖论:部分用户将警告视为系统具备自我意识与诚实性的标志,反而提升了可信度。进一步发现‘横幅盲视’现象,表明标准化警告无法阻止过度依赖。金融与医疗作为对照,揭示用户对警告的反应随情境与风险感知而异。研究对负责任的AI设计、算法公平与消费者保护具有重要启示。
原文摘要 · Abstract (English)
Current AI disclaimers often fail to function as intended due to warning habituation and a transparency paradox. As AI-generated information becomes pervasive in everyday decision-making, effective risk communication is increasingly critical for responsible design. This exploratory study examines how disclaimer placement and persuasive cues shape trust, perceived accuracy, and disclaimer engagement across three high-stakes domains: finance, medicine, and AI-generated content. Using a mixed within-between experimental design with 378 stimulus-level responses from 52 participants, we find that advisory content was generally trusted across conditions, even when disclaimers were present. A significant domain effect showed that medical content received the highest trust ratings. In the AI domain, the findings reveal a transparency paradox: some participants interpreted disclaimers not as warnings, but as signs of system self-awareness and honesty, paradoxically increasing perceived trustworthiness. Evidence of banner blindness further suggests that standardized AI disclaimers are insufficient to prevent over-reliance. Finance and medicine provide useful comparison domains by showing how users interpret warnings differently depending on context and perceived risk. These findings have vital implications for responsible AI design, algorithmic fairness, and consumer protection when users act on potentially misleading information in high-stakes settings.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。