研究盲人使用AI和说明书完成实物组装的困境与改进方向
Lost in Instructions: Study of Blind Users' Experiences with DIY Manuals and AI-Rewritten Instructions for Assembly, Operation, and Troubleshooting of Tangible Products
- 通过访谈与可用性测试，调研盲人使用AI和说明书完成实物任务的方式
- 现有说明书对盲人不友好，AI生成内容常不完整或误导
- 提出为盲人定制化生成实物操作指导的AI优化方向
像ChatGPT和Be-My-AI这样的AI工具正被越来越多的盲人使用。尽管已有研究探讨了盲人在部分自做（DIY）任务中使用这些工具的情况，但关于他们如何利用AI工具和产品说明书来完成需要空间推理、结构理解与精确执行的实物产品组装、操作及故障排查任务，仍知之甚少。本文通过访谈研究与可用性测试，调查盲人如何借助AI工具和产品说明书完成涉及实体产品的DIY任务。研究发现，说明书是关键资源，但现有说明书对盲人常不适用；当前的AI工具未能有效弥补这一不足，反而因内容不完整、逻辑混乱或误导性指导而加剧问题。最后，本文提出了针对盲人用户在实体产品相关DIY任务中生成定制化说明的AI改进建议。
原文摘要 · Abstract (English)
AI tools like ChatGPT and Be-My-AI are increasingly being used by blind individuals. Although prior work has explored their use in some Do-It-Yourself (DIY) tasks by blind individuals, little is known about how they use these tools and the available product-manual resources to assemble, operate, and troubleshoot physical or tangible products - tasks requiring spatial reasoning, structural understanding, and precise execution. We address this knowledge gap via an interview study and a usability study with blind participants, investigating how they leverage AI tools and product manuals for DIY tasks with physical products. Findings show that manuals are essential resources, but product-manual instructions are often inadequate for blind users. AI tools presently do not adequately address this insufficiency; in fact, we observed that they often exacerbate this issue with incomplete, incoherent, or misleading guidance. Lastly, we suggest improvements to AI tools for generating tailored instructions for blind users' DIY tasks involving tangible products.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。