用震动和声音反馈帮视障学生更好学编程。
HACI: A Haptic-Audio Code Interface to Improve Educational Outcomes for Visually Impaired Introductory Programming Students
- 通过振动手套与音频结合，让视障者非视觉感知代码结构。
- 试点研究显示工具能提升代码导航与理解能力。
- 适合视障编程教育者及无障碍技术开发者参考。
本论文提出触觉-音频代码接口（HACI），一种专为视障学生设计的编程教育工具，通过整合触觉与音频反馈弥补视觉缺失。HACI是一个轻量级网络应用，支持JavaScript程序开发、执行与调试，通过电缆连接由Arduino驱动的六电机振动手套，向视障程序员提供物理反馈。该研究基于促进计算机科学教育公平性的需求，旨在改善视障学生的非视觉代码导航、理解、总结、编辑与调试体验，同时降低认知负荷。论文详述了HACI的设计原则、技术实现，并通过本科生试点研究进行了初步评估。结果显示，HACI有助于非视觉方式理解和导航编程结构，但反馈机制的一致性与可靠性仍需优化；未来需增强功能丰富性与可定制性，以实现触觉与音频反馈的深度融合。研究凸显了触觉与音频反馈在视障教育中的变革潜力，为可访问编程教育的未来发展奠定基础。本工作推动了无障碍技术领域的发展，证明了触觉与听觉反馈在教育工具中的有效集成，拓展了STEM教育的可及性。
原文摘要 · Abstract (English)
This thesis introduces the Haptic-Audio Code Interface (HACI), an educational tool designed to enhance programming education for visually impaired (VI) students by integrating haptic and audio feedback to compensate for the absence of visual cues. HACI consists of a non-resource-intensive web application supporting JavaScript program development, execution, and debugging, connected via a cable to an Arduino-powered glove with six integrated haptic motors to provide physical feedback to VI programmers. Motivated by the need to provide equitable educational opportunities in computer science, HACI aims to improve non-visual code navigation, comprehension, summarizing, editing, and debugging for students with visual impairments while minimizing cognitive load. This work details HACI's design principles, technical implementation, and a preliminary evaluation through a pilot study conducted with undergraduate Computer Science students. Findings indicate that HACI aids in the non-visual navigation and understanding of programming constructs, although challenges remain in refining feedback mechanisms to ensure consistency and reliability, as well as supplementing the current functionality with a more feature-reach and customizable accessible learning experience which will allow visually impaired students to fully utilize interleaved haptic and audio feedback. The study underscores the transformative potential of haptic and audio feedback in educational practices for the visually impaired, setting a foundation for future research and development in accessible programming education. This thesis contributes to the field of accessible technology by demonstrating how tactile and auditory feedback can be effectively integrated into educational tools, thereby broadening accessibility in STEM education.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。