优化词对齐细节,让翻译迁移在命名实体识别上表现更稳定可靠
The Devil Is in the Word Alignment Details: On Translation-Based Cross-Lingual Transfer for Token Classification Tasks
- 系统研究词对齐器在跨语言标注任务中的具体应用策略
- 优化后基于词对齐的翻译迁移性能可媲美甚至超越标记法
- 提出新集成策略,降低对参数设置敏感性,提升模型鲁棒性
基于翻译的跨语言迁移(XLT)方法如translate-train和translate-test在命名实体识别等任务中表现良好。然而,其关键步骤——标签投影(将原文标签映射到译文)依赖词对齐器(WA),而低层设计选择(如多词跨度投影算法、噪声标签过滤策略、译文预分词方式)尚未被系统研究。尽管近年出现的标记法声称优于词对齐器,本文重新审视了词对齐器在标签投影中的作用,系统评估了上述三项设计因素的影响。结果表明,这些细节显著影响性能,并且通过优化配置,词对齐方法可达到与标记法相当的效果。进一步提出一种融合translate-train与translate-test预测的新策略,显著优于现有方法。更重要的是,该策略降低了对词对齐器具体设计的敏感度,使跨语言迁移更具鲁棒性。
原文摘要 · Abstract (English)
Translation-based strategies for cross-lingual transfer XLT such as translate-train -- training on noisy target language data translated from the source language -- and translate-test -- evaluating on noisy source language data translated from the target language -- are competitive XLT baselines. In XLT for token classification tasks, however, these strategies include label projection, the challenging step of mapping the labels from each token in the original sentence to its counterpart(s) in the translation. Although word aligners (WAs) are commonly used for label projection, the low-level design decisions for applying them to translation-based XLT have not been systematically investigated. Moreover, recent marker-based methods, which project labeled spans by inserting tags around them before (or after) translation, claim to outperform WAs in label projection for XLT. In this work, we revisit WAs for label projection, systematically investigating the effects of low-level design decisions on token-level XLT: (i) the algorithm for projecting labels between (multi-)token spans, (ii) filtering strategies to reduce the number of noisily mapped labels, and (iii) the pre-tokenization of the translated sentences. We find that all of these substantially impact translation-based XLT performance and show that, with optimized choices, XLT with WA offers performance at least comparable to that of marker-based methods. We then introduce a new projection strategy that ensembles translate-train and translate-test predictions and demonstrate that it substantially outperforms the marker-based projection. Crucially, we show that our proposed ensembling also reduces sensitivity to low-level WA design choices, resulting in more robust XLT for token classification tasks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。