通过关注源端指代项提升代词翻译准确率
Mention Attention for Pronoun Translation
- 在解码器中引入指代注意力模块,专注源端指代项
- 在WMT17英德翻译任务上,代词翻译指标提升明显
- 适合关注指代消解与跨语言代词差异的研究者
大多数代词是指代表达,计算机需确定其指代对象,而不同语言间代词使用存在差异,这给机器翻译带来挑战。提及项(mentions)是代词的潜在指代对象,相较于一般词元更接近代词。本文假设提取额外的提及特征有助于代词翻译,因此在解码器中引入额外的提及注意力模块,使模型更关注源端提及项而非非提及词元。该模块不仅从源端提及项提取特征,还结合目标端上下文信息,进一步提升代词翻译效果。同时,引入两个提及分类器训练模型识别提及项,其输出用于引导提及注意力。在WMT17英德翻译任务上进行实验,评估通用翻译与代词翻译性能,使用BLEU、APT及对比评估指标。结果表明,所提模型在APT和BLEU指标上均优于基线Transformer模型,验证了关注源端提及项可有效提升代词翻译,且不影响整体翻译质量。
原文摘要 · Abstract (English)
Most pronouns are referring expressions, computers need to resolve what do the pronouns refer to, and there are divergences on pronoun usage across languages. Thus, dealing with these divergences and translating pronouns is a challenge in machine translation. Mentions are referring candidates of pronouns and have closer relations with pronouns compared to general tokens. We assume that extracting additional mention features can help pronoun translation. Therefore, we introduce an additional mention attention module in the decoder to pay extra attention to source mentions but not non-mention tokens. Our mention attention module not only extracts features from source mentions, but also considers target-side context which benefits pronoun translation. In addition, we also introduce two mention classifiers to train models to recognize mentions, whose outputs guide the mention attention. We conduct experiments on the WMT17 English-German translation task, and evaluate our models on general translation and pronoun translation, using BLEU, APT, and contrastive evaluation metrics. Our proposed model outperforms the baseline Transformer model in terms of APT and BLEU scores, this confirms our hypothesis that we can improve pronoun translation by paying additional attention to source mentions, and shows that our introduced additional modules do not have negative effect on the general translation quality.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。