剖析文本编辑距离的局限性及其在翻译中的实际影响
Edit Distances and Their Applications to Downstream Tasks in Research and Commercial Contexts
- 用插入、删除、替换、移动四类操作解析编辑距离本质
- 揭示编辑距离与人工校对实际工作量存在显著偏差
- 适合研究机器翻译评估及翻译工具设计的从业者
本教程探讨编辑距离在科研与商业场景中的应用。通过Translation Edit Rate (TER)、Levenshtein、Damerau-Levenshtein、Longest Common Subsequence及$n$-gram距离，展示统计度量在比较文本序列时的脆弱性。我们拆解其核心组件，强调插入、删除、替换、移动四类编辑操作的中心地位，并介绍开源工具包中的实现方式。编辑距离常被用于下游任务，假设其能准确反映后编辑者的工作和机器翻译输出的真实错误。但本文指出，这些度量在捕捉实际纠错细节方面存在缺陷，对研究者与商业应用均具重要影响。在商业层面，讨论其在计算机辅助翻译工具中的集成，以及编辑距离与后编辑工作量感知如何影响译员计价标准。
原文摘要 · Abstract (English)
The tutorial describes the concept of edit distances applied to research and commercial contexts. We use Translation Edit Rate (TER), Levenshtein, Damerau-Levenshtein, Longest Common Subsequence and $n$-gram distances to demonstrate the frailty of statistical metrics when comparing text sequences. Our discussion disassembles them into their essential components. We discuss the centrality of four editing actions: insert, delete, replace and move words, and show their implementations in openly available packages and toolkits. The application of edit distances in downstream tasks often assumes that these accurately represent work done by post-editors and real errors that need to be corrected in MT output. We discuss how imperfect edit distances are in capturing the details of this error correction work and the implications for researchers and for commercial applications, of these uses of edit distances. In terms of commercial applications, we discuss their integration in computer-assisted translation tools and how the perception of the connection between edit distances and post-editor effort affects the definition of translator rates.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。