arXiv:2506.04811cs.CL2025-06被引 1

融合CNN与BERT的智能校对系统,显著提升英德翻译纠错能力。

Design of intelligent proofreading system for English translation based on CNN and BERT

  • 用CNN捕捉局部词组模式,BERT建模全局上下文语义。
  • 在WMT和Open-Subtitles数据集上达到90%准确率,超越现有方法超10%。
  • 适合需要高精度机器翻译后编辑的场景,如专业文档校对。

自动翻译常含错误,需大量人工润色,因此机器翻译校对至关重要。本文提出一种结合卷积神经网络(CNN)与双向编码器表示(BERT)的混合方法,以实现稳健的校对。CNN通过多种卷积核滤波器提取短语和表达中的语义信息,捕捉局部n-gram模式;BERT则利用堆叠的双向Transformer编码器生成完整序列的上下文丰富表示。通过BERT的注意力机制,集成的错误检测模块可关联词元,识别出语序错乱、遗漏等翻译异常。随后,校正模块结合并行英德对齐与GRU解码器模型及翻译记忆库,提出逻辑合理的修改建议,同时保留原文含义。整个流程采用针对润色性能优化的端到端训练策略。模型在多领域WMT数据集和对话类Open-Subtitles数据集上训练,由多个损失函数监督检测与校正能力。实验结果显示,准确率达90%,F1值为89.37%,均方误差为16.24%,整体性能较近期技术提升超10%。对比基准测试表明,该方法在识别与连贯修正误译及遗漏方面表现达到当前最优水平。

原文摘要 · Abstract (English)

Since automatic translations can contain errors that require substantial human post-editing, machine translation proofreading is essential for improving quality. This paper proposes a novel hybrid approach for robust proofreading that combines convolutional neural networks (CNN) with Bidirectional Encoder Representations from Transformers (BERT). In order to extract semantic information from phrases and expressions, CNN uses a variety of convolution kernel filters to capture local n-gram patterns. In the meanwhile, BERT creates context-rich representations of whole sequences by utilizing stacked bidirectional transformer encoders. Using BERT's attention processes, the integrated error detection component relates tokens to spot translation irregularities including word order problems and omissions. The correction module then uses parallel English-German alignment and GRU decoder models in conjunction with translation memory to propose logical modifications that maintain original meaning. A unified end-to-end training process optimized for post-editing performance is applied to the whole pipeline. The multi-domain collection of WMT and the conversational dialogues of Open-Subtitles are two of the English-German parallel corpora used to train the model. Multiple loss functions supervise detection and correction capabilities. Experiments attain a 90% accuracy, 89.37% F1, and 16.24% MSE, exceeding recent proofreading techniques by over 10% overall. Comparative benchmarking demonstrates state-of-the-art performance in identifying and coherently rectifying mistranslations and omissions.

机器校对BERTCNN翻译纠错

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。