用大模型打造虚拟现实盲人导航助手，发现用户会把它当伙伴而非工具。
Understanding the Use of a Large Language Model-Powered Guide to Make Virtual Reality Accessible for Blind and Low Vision People
- 用大语言模型构建虚拟现实中的智能导览助手。
- 16名视障者测试中，与他人在场时更将助手视为有情感的同伴。
- 适合做无障碍设计、人机交互和通用辅助系统的研究参考。
随着社交虚拟现实（VR）日益流行，为视障或低视力（BLV）用户提升可及性变得愈发重要。已有研究提出由人工智能充当“明眼向导”帮助用户在虚拟环境中导航并回答问题，但尚未经过真实用户验证。为此，我们开发了一个基于大语言模型（LLM）的导览系统，并在包含16名BLV参与者的真实虚拟环境测试中，让同伙扮演其他用户进行互动。结果发现，当独自使用时，参与者将导览助手视为工具；但在他人在场时，会赋予其昵称，为其错误辩护，还主动促进同伙与导览助手之间的互动。该研究深化了对导览系统作为多功能无障碍方法的理解，并为未来导览系统的设计提供了实践建议。
原文摘要 · Abstract (English)
As social virtual reality (VR) grows more popular, addressing accessibility for blind and low vision (BLV) users is increasingly critical. Researchers have proposed an AI "sighted guide" to help users navigate VR and answer their questions, but it has not been studied with users. To address this gap, we developed a large language model (LLM)-powered guide and studied its use with 16 BLV participants in virtual environments with confederates posing as other users. We found that when alone, participants treated the guide as a tool, but treated it companionably around others, giving it nicknames, rationalizing its mistakes with its appearance, and encouraging confederate-guide interaction. Our work furthers understanding of guides as a versatile method for VR accessibility and presents design recommendations for future guides.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。