arXiv:2604.26361cs.CLcs.AI2026-04

提升图文设计翻译时的字词对齐精度,保持原文字体风格。

Text Style Transfer with Machine Translation for Graphic Designs

论文配图:Text Style Transfer with Machine Translation for Graphic Designs
图 1 · 摘自论文原文
  • 用自定义标签引导NMT与LLM实现风格迁移
  • 混合方法(NMT+LLM)对齐效果接近注意力头基准
  • 适用于广告、杂志等需保留视觉风格的设计场景

全球化背景下,营销材料和杂志等图形设计的文本内容需准确翻译并保留原有字体样式以确保视觉一致性。实现这一目标的关键在于源文本与译文间高精度的词级对齐。当前行业标准依赖Giza++及神经机器翻译(NMT)模型的注意力概率进行对齐。本文探索三种新方法解决此问题:基于自定义输入输出标签的NMT;基于自定义标签的大型语言模型(LLM);以及先用NMT翻译、再通过一元词映射由LLM优化的混合方法。通过与注意力头方法对比评估性能,结果表明注意力头基准表现优于单独使用LLM或NMT的方法,且与混合方法相当,验证了其在图形设计应用中的可行性。

原文摘要 · Abstract (English)

Globalization of graphic designs such as those used in marketing materials and magazines is increasingly important for communication to broad audiences. To accomplish this, the textual content in the graphic designs needs to be accurately translated and have the text styling preserved in order to fit visually into the design. Preserving text styling requires high accuracy word alignment between the original and the translated text. The problem of word alignment between source and translated text is long known. The industry standards for extracting word alignments are defined by Giza++ and attention probabilities from neural machine translation (NMT) models. In this paper, we explore three new methods to tackle the word alignment problem for transferring text styles from the source to the translated text. The proposed methods are developed on top of commercially available NMT and LLM translation technologies. They include: NMT with custom input and output tags for text styling; LLM with custom input and output tags; a hybrid with NMT for translation followed by an LLM with use of unigram mappings. To analyze the performance of these solutions, their alignment results are compared with the results of an attention head approach to gauge their usability in graphic design applications. Interestingly, the attention head strong baseline proves more accurate than the LLM or NMT approach and on par with the hybrid NMT+LLM approach.

文本风格迁移机器翻译图文设计

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。