arXiv:1409.04730cs.CLcs.LG2014-09

让翻译模型自动找关键词对应关系,提升翻译质量。

Neural Machine Translation by Jointly Learning to Align and Translate

  • 引入软对齐机制,动态搜索源句相关部分
  • 在英法翻译上达到顶尖词典翻译系统水平
  • 适合关注神经机器翻译改进的从业者

神经机器翻译是一种新兴的机器翻译方法,与传统统计机器翻译不同,它旨在构建一个单一神经网络,可联合优化以最大化翻译性能。近期提出的神经机器翻译模型多采用编码器-解码器结构,其中编码器将源句编码为固定长度向量,解码器基于该向量生成目标语言翻译。本文认为,使用固定长度向量是该基础架构的性能瓶颈,提出通过允许模型自动(软)搜索源句中与目标词预测相关的部分,而无需显式划分语义段。新方法在英法翻译任务上达到了与现有顶尖短语基系统相当的翻译性能。定性分析表明,模型学习到的(软)对齐结果与人类直觉高度一致。

原文摘要 · Abstract (English)

Neural machine translation is a recently proposed approach to machine translation. Unlike the traditional statistical machine translation, the neural machine translation aims at building a single neural network that can be jointly tuned to maximize the translation performance. The models proposed recently for neural machine translation often belong to a family of encoder-decoders and consists of an encoder that encodes a source sentence into a fixed-length vector from which a decoder generates a translation. In this paper, we conjecture that the use of a fixed-length vector is a bottleneck in improving the performance of this basic encoder-decoder architecture, and propose to extend this by allowing a model to automatically (soft-)search for parts of a source sentence that are relevant to predicting a target word, without having to form these parts as a hard segment explicitly. With this new approach, we achieve a translation performance comparable to the existing state-of-the-art phrase-based system on the task of English-to-French translation. Furthermore, qualitative analysis reveals that the (soft-)alignments found by the model agree well with our intuition.

机器翻译注意力机制序列建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。