arXiv:2503.15120cs.HCcs.SD2025-03被引 6

让普通人协作纠错语音识别,提升聋哑人实时字幕可读性。

Communication Access Real-Time Translation Through Collaborative Correction of Automatic Speech Recognition

  • 普通人协作实时修正语音识别错误,降低专业人员依赖。
  • 75人实验表明协作纠错后字幕可懂度显著提升,获聋哑用户正面评价。
  • 适合需要低成本、高可用性实时字幕的场景,如会议、课堂。

通信无障碍实时翻译(CART)对聋哑及听力障碍者至关重要,但训练有素的专业人员稀缺且成本高昂。自动语音识别(ASR)虽具成本低、可扩展的优势,但转录错误可能引发严重可及性问题。本文探索由非专业人士协作修正ASR的新型CART流程。通过75名参与者用户研究评估该流程的可行性与效率,并对25名聋哑人士开展焦点小组访谈,确定可接受的准确率及影响实时字幕可及性的因素。结果表明,协作编辑可将转录准确率提升至聋哑用户认可的可懂水平;焦点小组还显示,人为努力改善字幕备受重视,支持采用半自动化模式作为独立ASR或传统CART服务的替代方案。

原文摘要 · Abstract (English)

Communication access real-time translation (CART) is an essential accessibility service for d/Deaf and hard of hearing (DHH) individuals, but the cost and scarcity of trained personnel limit its availability. While Automatic Speech Recognition (ASR) offers a cheap and scalable alternative, transcription errors can lead to serious accessibility issues. Real-time correction of ASR by non-professionals presents an under-explored CART workflow that addresses these limitations. We conducted a user study with 75 participants to evaluate the feasibility and efficiency of this workflow. Complementary, we held focus groups with 25 DHH individuals to identify acceptable accuracy levels and factors affecting the accessibility of real-time captioning. Results suggest that collaborative editing can improve transcription accuracy to the extent that DHH users rate it positively regarding understandability. Focus groups also showed that human effort to improve captioning is highly valued, supporting a semi-automated approach as an alternative to stand-alone ASR and traditional CART services.

语音识别实时字幕无障碍协作纠错

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。