用多层级记忆机制提升文档翻译一致性与准确率
DelTA: An Online Document-Level Translation Agent Based on Multi-Level Memory
- 设计多级记忆结构,分层存储专有名词、双语摘要等信息
- 在4个大模型上实现一致性和COMET得分最高提升4.58和3.16点
- 适合需要高保真文档翻译的场景,如法律、技术文件
大型语言模型(LLMs)在机器翻译中取得了显著进步,但现有研究在处理整篇文档时仍面临翻译一致性和准确性不足的问题。本文提出DelTA,一个基于多级记忆的文档级翻译代理。其包含专有名词记录、双语摘要、长期记忆和短期记忆四层结构,由辅助的LLM组件持续检索与更新。实验表明,DelTA在四个开源/闭源大模型及两个代表性文档翻译数据集上显著优于强基线,一致性得分最高提升4.58个百分点,COMET平均提升3.16点。该方法采用逐句翻译策略,避免遗漏,且内存效率高于主流方法。同时提升了代词与上下文相关翻译的准确性,其摘要组件在查询式摘要任务中也表现良好。代码与数据已公开于https://github.com/YutongWang1216/DocMTAgent。
原文摘要 · Abstract (English)
Large language models (LLMs) have achieved reasonable quality improvements in machine translation (MT). However, most current research on MT-LLMs still faces significant challenges in maintaining translation consistency and accuracy when processing entire documents. In this paper, we introduce DelTA, a Document-levEL Translation Agent designed to overcome these limitations. DelTA features a multi-level memory structure that stores information across various granularities and spans, including Proper Noun Records, Bilingual Summary, Long-Term Memory, and Short-Term Memory, which are continuously retrieved and updated by auxiliary LLM-based components. Experimental results indicate that DelTA significantly outperforms strong baselines in terms of translation consistency and quality across four open/closed-source LLMs and two representative document translation datasets, achieving an increase in consistency scores by up to 4.58 percentage points and in COMET scores by up to 3.16 points on average. DelTA employs a sentence-by-sentence translation strategy, ensuring no sentence omissions and offering a memory-efficient solution compared to the mainstream method. Furthermore, DelTA improves pronoun and context-dependent translation accuracy, and the summary component of the agent also shows promise as a tool for query-based summarization tasks. The code and data of our approach are released at https://github.com/YutongWang1216/DocMTAgent.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。