为自由译者提供可落地的翻译评估工具,助力技术转型
Translation Analytics for Freelancers: I. Introduction, Data Preparation, Baseline Evaluations
- 将BLEU、chrF等自动评估指标适配至自由译者工作流
- 实证显示自动评分与人工评价高度相关(医疗领域三语数据集)
- 适合想提升效率的自由译者及小规模语言服务提供者
本系列首篇论文探讨语言技术进步为个体译者及资源有限的语言服务商带来的新机遇。先进神经机器翻译系统、大语言模型及其通过计算机辅助翻译工具和翻译管理系统集成,已重塑翻译行业,不仅实现翻译,还可进行质量评估、错误检测、术语表生成和领域适应,为自由译者创造新可能。本文提出翻译分析方法,将原本仅用于大规模产业的评估技术推向中小型用户。研究构建了一个来自真实医疗项目的真实三语语料库,对BLEU、chrF、TER、COMET等指标进行适配,并通过统计分析揭示自动评分与人工评价的高度相关性,强调译者主动拥抱新技术,方能在职业环境中持续发展。
原文摘要 · Abstract (English)
This is the first in a series of papers exploring the rapidly expanding new opportunities arising from recent progress in language technologies for individual translators and language service providers with modest resources. The advent of advanced neural machine translation systems, large language models, and their integration into workflows via computer-assisted translation tools and translation management systems have reshaped the translation landscape. These advancements enable not only translation but also quality evaluation, error spotting, glossary generation, and adaptation to domain-specific needs, creating new technical opportunities for freelancers. In this series, we aim to empower translators with actionable methods to harness these advancements. Our approach emphasizes Translation Analytics, a suite of evaluation techniques traditionally reserved for large-scale industry applications but now becoming increasingly available for smaller-scale users. This first paper introduces a practical framework for adapting automatic evaluation metrics -- such as BLEU, chrF, TER, and COMET -- to freelancers' needs. We illustrate the potential of these metrics using a trilingual corpus derived from a real-world project in the medical domain and provide statistical analysis correlating human evaluations with automatic scores. Our findings emphasize the importance of proactive engagement with emerging technologies to not only adapt but thrive in the evolving professional environment.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。