arXiv:2501.05213cs.CLcs.AI2025-01

打造希腊语多模态唇读数据集,助力聋哑人群无障碍沟通

GLaM-Sign: Greek Language Multimodal Lip Reading with Integrated Sign Language Accessibility

  • 融合音视频、字幕与希腊手语翻译的多模态数据集
  • 支持实时手语翻译与字幕同步,提升沟通效率
  • 适用于旅游、教育等场景,推动无障碍技术发展

GLaM-Sign 是一项面向希腊语多模态唇读与手语可访问性的创新资源,由 FEELIT 项目发展而来,整合高分辨率音频、视频、文本转录及希腊手语翻译,可用于实时手语翻译与字幕精准同步。其主要目标是提升希腊旅游行业的包容性,同时具备在教育、医疗和公共服务领域的扩展潜力。未来将通过先进AI方法提升词级精度并拓展至更多语言,依托多方协作持续推进。该数据集展示了多模态资源在弥合沟通鸿沟、推动技术创新方面的巨大潜力,为伦理导向的包容性AI树立了标杆。

原文摘要 · Abstract (English)

The Greek Language Multimodal Lip Reading with Integrated Sign Language Accessibility (GLaM-Sign) [1] is a groundbreaking resource in accessibility and multimodal AI, designed to support Deaf and Hard-of-Hearing (DHH) individuals. Developed from the FEELIT project [2], it integrates high-resolution audio, video, textual transcriptions, and Greek Sign Language translations for applications like real-time sign language translation and enhanced subtitle synchronization. While its primary focus is on promoting inclusivity in the Greek tourism sector, its adaptability extends to education, healthcare, and public services. Future advancements will enhance word-level precision and scalability to additional languages, supported by advanced AI methodologies and collaborations with diverse stakeholders. This dataset underscores the transformative potential of multimodal resources in bridging communication gaps, fostering innovation, and setting a benchmark for ethical AI and inclusive technologies.

多模态无障碍手语翻译希腊语

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。