arXiv:2505.16612cs.CLcs.AI2025-05Conference of the …被引 2

用少量样例让大模型生成有特定译者风格的文学翻译。

Steering Large Language Models for Machine Translation Personalization

  • 通过对比稀疏自编码器潜空间,精准识别译者风格特征。
  • 在少样本下实现高质量个性化翻译,推理效率高于提示法。
  • 揭示了提示与潜空间干预共享相似神经机制。

大型语言模型已能生成符合预设风格约束的个性化翻译,但在风格由少数样例隐式表达(如特定译者文本)时仍面临挑战。本文探索在仅有少量示例条件下实现自动翻译个性化的方法,聚焦于文学翻译这一难点领域。首先验证任务可行性,并研究风格信息在模型表征中的编码方式;随后评估多种提示策略与推理时干预方法,重点采用对比稀疏自编码器(SAE)潜空间进行风格引导。结果表明,对比SAE引导在风格控制与翻译质量上表现稳健,且推理计算效率优于传统提示方法。进一步分析发现,提示与SAE引导均影响编码个性化特征的网络层,暗示二者可能遵循相似作用机制。

原文摘要 · Abstract (English)

Large language models have simplified the production of personalized translations reflecting predefined stylistic constraints. However, these systems still struggle when stylistic requirements are implicitly represented by a set of examples, such as texts produced by a specific human translator. In this work, we explore various strategies for personalizing automatically generated translations when few examples are available, with a focus on the challenging domain of literary translation. We begin by determining the feasibility of the task and how style information is encoded within model representations. Then, we evaluate various prompting strategies and inference-time interventions for steering model generations towards a personalized style, with a particular focus on contrastive steering with sparse autoencoder (SAE) latents to identify salient personalization properties. We demonstrate that contrastive SAE steering yields robust style conditioning and translation quality, resulting in higher inference-time computational efficiency than prompting approaches. We further examine the impact of steering on model activations, finding that layers encoding personalization properties are impacted similarly by prompting and SAE steering, suggesting a similar mechanism at play.

机器翻译风格控制少样本学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。