用ROC分析评估机器翻译质量估计系统，更利于业务决策。
ROC Analysis for Evaluating Translation Quality Estimation Systems
- 采用ROC分析替代传统方法评估翻译质量估计性能
- 结果与主流方法一致且提供可操作的性能洞察
- 适合关注实际应用效果的翻译系统开发者
自动化翻译质量估计（QE）系统日益普及，亟需实用、面向决策的性能评估方法。本文提出，受试者工作特征（ROC）分析是评估此类系统性能的有效手段。研究显示，ROC分析不仅结果与现有主流方法一致，还具备多项重要优势，包括为商业决策提供可操作的性能洞察，提升评估的实用性与指导意义。
原文摘要 · Abstract (English)
The increasing use of automated translation quality estimation (QE) systems calls for practical, decision-oriented methods for evaluating their performance. We propose that Receiver Operating Characteristic (ROC) analysis is a useful approach for this purpose. Our study shows that ROC analysis not only produces results consistent with currently prevalent methods, but also offers several important advantages, including actionable performance insights that support business decision-making.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。