专为社交网络内容优化的720亿参数大模型,提升梗图和流行语翻译质量。
Redefining Machine Translation on Social Network Services with Large Language Models
- 用双LLM回译采样法筛选多样数据,大规模微调模型
- 通过专家标注修正偏好对,构建可靠训练数据集
- 首个社交网络翻译评测基准,覆盖幽默和表情包适配
社交互动全球化推动了社交网络服务(SNS)机器翻译需求,但传统模型难以处理梗图、俚语和流行文化引用等文化敏感内容。尽管大语言模型(LLMs)在通用翻译上取得进展,其在SNS特定内容上的表现仍受限于缺乏专业训练数据和评估基准。本文提出面向SNS翻译的720亿参数模型RedTrans,基于三项创新:(1)监督微调中的双LLM回译采样,利用LLM回译实现无监督数据筛选,用于大规模微调;(2)重写偏好优化(RePO),通过专家标注识别并修正错误偏好对,构建可信偏好语料;(3)RedTrans-Bench,首个SNS翻译评测基准,评估幽默本地化、表情符号语义及梗图改编等现象。实验表明,RedTrans显著优于现有最先进模型。此外,RedTrans已投入真实生产环境,证明领域特化有效弥合通用与文化语境化翻译系统间的差距。
原文摘要 · Abstract (English)
The globalization of social interactions has heightened the need for machine translation (MT) on Social Network Services (SNS), yet traditional models struggle with culturally nuanced content like memes, slang, and pop culture references. While large language models (LLMs) have advanced general-purpose translation, their performance on SNS-specific content remains limited due to insufficient specialized training data and evaluation benchmarks. This paper introduces RedTrans, a 72B LLM tailored for SNS translation, trained on a novel dataset developed through three innovations: (1) Supervised Finetuning with Dual-LLM Back-Translation Sampling, an unsupervised sampling method using LLM-based back-translation to select diverse data for large-scale finetuning; (2) Rewritten Preference Optimization (RePO), an algorithm that identifies and corrects erroneous preference pairs through expert annotation, building reliable preference corpora; and (3) RedTrans-Bench, the first benchmark for SNS translation, evaluating phenomena like humor localization, emoji semantics, and meme adaptation. Experiments show RedTrans outperforms state-of-the-art LLMs. Besides, RedTrans has already been deployed in a real-world production environment, demonstrating that domain-specific adaptation, effectively bridges the gap between generic and culturally grounded translation systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。