为柏柏尔语构建社区驱动的语言技术，解决数据稀缺难题
Awal -- Community-Powered Language Technology for Tamazight
- 通过社区平台征集翻译与语音数据，推动柏柏尔语数字化
- 18个月收集6421对翻译数据和3小时语音，但参与度集中于专家
- 适合关注小语种、社区共建与语言保护的研究者
本文介绍 Awal，一项针对柏柏尔语的社区驱动语言技术计划。我们综述了柏柏尔语自然语言处理的发展现状，分析了近期计算资源进展及社区主导方法在应对数据稀缺方面的兴起。2024年启动的 awaldigital.org 平台旨在改善柏柏尔语在数字空间中的代表性，通过协作平台鼓励使用者贡献翻译与语音数据。我们分析了18个月的社区参与情况，发现主要障碍包括对书面柏柏尔语信心不足及标准化持续挑战。尽管广受好评，实际数据贡献仍集中于语言学家和活动人士。目前收集的数据量有限：6,421对翻译数据和3小时语音数据，表明标准众包模式在复杂社会语言背景下存在局限。我们正基于这些数据开发改进的开源机器翻译模型。
原文摘要 · Abstract (English)
This paper presents Awal, a community-powered initiative for developing language technology resources for Tamazight. We provide a comprehensive review of the NLP landscape for Tamazight, examining recent progress in computational resources, and the emergence of community-driven approaches to address persistent data scarcity. Launched in 2024, awaldigital.org platform addresses the underrepresentation of Tamazight in digital spaces through a collaborative platform enabling speakers to contribute translation and voice data. We analyze 18 months of community engagement, revealing significant barriers to participation including limited confidence in written Tamazight and ongoing standardization challenges. Despite widespread positive reception, actual data contribution remained concentrated among linguists and activists. The modest scale of community contributions -- 6,421 translation pairs and 3 hours of speech data -- highlights the limitations of applying standard crowdsourcing approaches to languages with complex sociolinguistic contexts. We are working on improved open-source MT models using the collected data.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。