构建首个面向STEM教育的美式手语连续视频数据集，助力听障学生学习。
ASL STEM Wiki: Dataset and Benchmark for Interpreting STEM Articles
- 采集254篇科学类维基文章，转译为300+小时美式手语视频。
- 发现技术术语频繁使用指拼法，影响听障学生理解。
- 开发指拼词识别模型，可辅助生成对应手语表达建议。
听力障碍和重听（DHH）学生在获取科学、技术、工程与数学（STEM）教育方面面临显著障碍，主要由于缺乏用手语呈现的STEM资源。为此，我们推出了ASL STEM Wiki：一个包含254篇英文科学主题维基文章的双语语料库，已转译为超过300小时的美国手语（ASL）视频。ASL STEM Wiki是首个专注于STEM领域的连续手语数据集，有助于推动面向听障学生的手语AI教育资源发展。我们识别出多个以用户为中心的应用场景。例如，该数据集揭示了技术概念常通过指拼法表达，这会阻碍听障学生的学习。基于此，我们开发了识别指拼词的模型，未来可用于查询并推荐合适的ASL手语符号，供翻译人员参考。
原文摘要 · Abstract (English)
Deaf and hard-of-hearing (DHH) students face significant barriers in accessing science, technology, engineering, and mathematics (STEM) education, notably due to the scarcity of STEM resources in signed languages. To help address this, we introduce ASL STEM Wiki: a parallel corpus of 254 Wikipedia articles on STEM topics in English, interpreted into over 300 hours of American Sign Language (ASL). ASL STEM Wiki is the first continuous signing dataset focused on STEM, facilitating the development of AI resources for STEM education in ASL. We identify several use cases of ASL STEM Wiki with human-centered applications. For example, because this dataset highlights the frequent use of fingerspelling for technical concepts, which inhibits DHH students' ability to learn, we develop models to identify fingerspelled words -- which can later be used to query for appropriate ASL signs to suggest to interpreters.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。