arXiv:2412.03877cs.CLcs.AI2024-12被引 1

高精度泰国名拉丁化模型,兼顾发音与文化偏好。

AyutthayaAlpha: A Thai-Latin Script Transliteration Transformer

  • 用双模型架构融合语言规则与深度学习,提升音调和元音长度识别。
  • 首词准确率82.32%,前三词准确率95.24%,字符错误率仅0.0047。
  • 适合政府数据库、国际身份认证等需精准罗马化的场景。

本研究提出AyutthayaAlpha,一种基于Transformer的机器学习模型,用于将泰语姓名准确转写为拉丁字母。系统在120万条泰-拉丁姓名对数据上训练,并通过策略性上采样扩展至270万例。模型采用创新双架构:基于ByT5的AyutthayaAlpha-Small与计算高效的AyutthayaAlpha-VerySmall,后者意外表现更优。其首词准确率达82.32%,前三词准确率为95.24%,字符错误率低至0.0047。该方法有效应对泰语声调与元音长短等复杂语音特征挑战,显著优于现有方法并接近人工专家水平。研究成果可应用于跨语言信息检索、国际数据标准化及身份验证系统,尤其适用于政府档案、学术机构与全球商业场景,推动泰语与拉丁字母间的语言桥梁建设,同时尊重姓名背后的文化与个人习惯。

原文摘要 · Abstract (English)

This study introduces AyutthayaAlpha, an advanced transformer-based machine learning model designed for the transliteration of Thai proper names into Latin script. Our system achieves state-of-the-art performance with 82.32% first-token accuracy and 95.24% first-three-token accuracy, while maintaining a low character error rate of 0.0047. The complexity of Thai phonology, including tonal features and vowel length distinctions, presents significant challenges for accurate transliteration, which we address through a novel two-model approach: AyutthayaAlpha-Small, based on the ByT5 architecture, and AyutthayaAlpha-VerySmall, a computationally efficient variant that unexpectedly outperforms its larger counterpart. Our research combines linguistic rules with deep learning, training on a carefully curated dataset of 1.2 million Thai-Latin name pairs, augmented through strategic upsampling to 2.7 million examples. Extensive evaluations against existing transliteration methods and human expert benchmarks demonstrate that AyutthayaAlpha not only achieves superior accuracy but also effectively captures personal and cultural preferences in name romanization. The system's practical applications extend to cross-lingual information retrieval, international data standardization, and identity verification systems, with particular relevance for government databases, academic institutions, and global business operations. This work represents a significant advance in bridging linguistic gaps between Thai and Latin scripts, while respecting the cultural and personal dimensions of name transliteration.

名称转写泰国语Transformer语音识别

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。