用视觉模型处理希伯来语声调,让机器自动补全发音符号。
Hebrew Diacritics Restoration using Visual Representation
- 把补全声调看作零样本分类,从上下文选最佳方案。
- 在理想情况下准确率很高,且无需复杂语言分析。
- 适合做希伯来语文本自动化处理的研究者与开发者。
希伯来语声调恢复是确保词汇发音准确和消除文本歧义的基础任务。尽管无声调文本存在高度模糊性,近年来的机器学习方法已显著提升该任务性能。本文提出DiVRit,一种新型希伯来语声调恢复系统,将任务视为零样本分类问题。该方法在词级进行,基于上下文动态生成候选集,从中选择最合适的声调模式。核心创新在于使用希伯来语视觉语言模型将带声调的候选词作为图像处理,使声调信息直接嵌入向量表示中,而上下文仍保持分词形式。在多种配置下的全面评估表明,系统无需依赖复杂的显式语言分析即可有效完成声调恢复。值得注意的是,在“理想”设定下(正确声调形式保证存在于候选集中),DiVRit表现优异。此外,架构优化与训练策略改进显著提升了系统的泛化能力。这些发现凸显了视觉表示在精准、自动化希伯来语声调恢复中的巨大潜力。
原文摘要 · Abstract (English)
Diacritics restoration in Hebrew is a fundamental task for ensuring accurate word pronunciation and disambiguating textual meaning. Despite the language's high degree of ambiguity when unvocalized, recent machine learning approaches have significantly advanced performance on this task. In this work, we present DiVRit, a novel system for Hebrew diacritization that frames the task as a zero-shot classification problem. Our approach operates at the word level, selecting the most appropriate diacritization pattern for each undiacritized word from a dynamically generated candidate set, conditioned on the surrounding textual context. A key innovation of DiVRit is its use of a Hebrew Visual Language Model to process diacritized candidates as images, allowing diacritic information to be embedded directly within their vector representations while the surrounding context remains tokenization-based. Through a comprehensive evaluation across various configurations, we demonstrate that the system effectively performs diacritization without relying on complex, explicit linguistic analysis. Notably, in an ``oracle'' setting where the correct diacritized form is guaranteed to be among the provided candidates, DiVRit achieves a high level of accuracy. Furthermore, strategic architectural enhancements and optimized training methodologies yield significant improvements in the system's overall generalization capabilities. These findings highlight the promising potential of visual representations for accurate and automated Hebrew diacritization.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。