用故事启发人们提前想象医疗AI的潜在危害
Telling Speculative Stories to Help Humans Imagine the Harms of Healthcare AI
- 通过生成用户故事和多角色讨论，引导思考AI在医疗中的影响
- 读故事的参与者识别出17类危害中的更多类型，分布更均衡
- 适合政策制定者、设计师及伦理审查人员参考
人工智能正快速改变医疗领域，催生压力监测、健康追踪器和心理健康聊天机器人等工具。然而，快速且低门槛的开发可能带来偏见、隐私泄露和获取不均等风险，尤其当系统忽视真实场景与多元用户需求时。现有方法多依赖AI自动检测风险，但易削弱人类对危害成因及影响对象的理解参与。本文提出一种以人为中心的框架，通过生成用户故事并支持多代理对话，帮助人们在部署前创造性地思考潜在利弊。用户研究显示，阅读故事的参与者能识别更广泛的危害，其响应在17类危害中分布更均匀；而未读故事者主要关注隐私与福祉（占比79.1%）。结果表明，讲故事有助于拓展对医疗AI影响的想象力，提升对潜在风险与收益的全面认知。
原文摘要 · Abstract (English)
Artificial intelligence (AI) is rapidly transforming healthcare, enabling fast development of tools like stress monitors, wellness trackers, and mental health chatbots. However, rapid and low-barrier development can introduce risks of bias, privacy violations, and unequal access, especially when systems ignore real-world contexts and diverse user needs. Many recent methods use AI to detect risks automatically, but this can reduce human engagement in understanding how harms arise and who they affect. We present a human-centered framework that generates user stories and supports multi-agent discussions to help people think creatively about potential benefits and harms before deployment. In a user study, participants who read stories recognized a broader range of harms, distributing their responses more evenly across all 17 harm types. In contrast, those who did not read stories focused primarily on privacy and well-being (79.1%). Our findings show that storytelling helped participants speculate about a broader range of harms and benefits and think more creatively about AI's impact on users.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。