自动挑选低频词字典,翻译更省 token 还更准
SLoW: Select Low-frequency Words! Automatic Dictionary Selection for Translation on Large Language Models
- 根据词频选择字典,不依赖训练数据
- 100 语言测试中性能超基线,部分语言更优
- 适合资源有限但需多语言翻译的场景
全球有超过7000种语言,当前大语言模型仅支持数百种。基于字典的提示方法可提升翻译效果,但多数方法使用全部字典,成本高。本文提出自动字典选择(ADS)任务,并设计SLoW方法:选择低频词字典。该方法无需访问训练数据即可估计词频,且无需微调模型。在FLORES的100种语言上实验显示,SLoW超越强基线,显著节省token消耗,部分语言翻译性能甚至优于全字典基线。
原文摘要 · Abstract (English)
There are more than 7,000 languages around the world, and current Large Language Models (LLMs) only support hundreds of languages. Dictionary-based prompting methods can enhance translation on them, but most methods use all the available dictionaries, which could be expensive. Instead, it will be flexible to have a trade-off between token consumption and translation performance. This paper proposes a novel task called \textbf{A}utomatic \textbf{D}ictionary \textbf{S}election (\textbf{ADS}). The goal of the task is to automatically select which dictionary to use to enhance translation. We propose a novel and effective method which we call \textbf{S}elect \textbf{Lo}w-frequency \textbf{W}ords! (\textbf{SLoW}) which selects those dictionaries that have a lower frequency. Our methods have unique advantages. First, there is no need for access to the training data for frequency estimation (which is usually unavailable). Second, it inherits the advantage of dictionary-based methods, where no additional tuning is required on LLMs. Experimental results on 100 languages from FLORES indicate that SLoW surpasses strong baselines, and it can obviously save token usage, with many languages even surpassing the translation performance of the full dictionary baseline.\footnote{A shocking fact is that there is no need to use the actual training data (often unobtainable) for frequency estimation, and an estimation frequency obtained using public resources is still apparently effective in improving translation with ChatGPT and Llama, and DeepSeek.}\footnote{Code and data available upon publication.}
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。