arXiv:2605.03387cs.CL2026-05

用检索增强提示提升日中翻译中修饰句的准确性。

From prompting to evidence-based translation: A RAG+prompt system for Japanese-Chinese translation and its pedagogical potential

  • 结合语言分析与相似例句检索,动态构建增强提示。
  • 知识库规模达2000时,翻译得分提升23.4%至29.96。
  • 适合教学场景,结果可解释且可审计。

大语言模型在高资源语对上表现良好,但在包含名词修饰从句(NMCC)的日中句子上可靠性较低。本研究评估了一种无需修改基础模型的RAG+Prompt翻译系统,该系统整合了语言学分析、基于嵌入的检索、提示构造与LLM生成。分析模块输出A1(内部/外部NMCC)和A2(词汇选择/从句处理/语序/风格/语体风险预测);通过L2距离选取前k=5个相似日中例句及A1/A2信息,插入增强提示中。使用GPT-4o和66句测试集,对比0/100/200/500/1,000/2,000共六种知识库规模。以宏观平均句级BLEU(1-4元语法,含简略惩罚,区分大小写,中文按字级)为唯一指标。平均BLEU从0(禁用RAG)时的24.28升至2,000时的29.96(+5.68,+23.4%),趋势持续向好。结论:RAG+Prompt系统以可解释、可审计方式显著提升日中含NMCC句子的翻译质量。局限包括仅用一个基模型、单一指标,依赖公开文本与商用API;未来将拓展语料类型、语言对与评估维度。

原文摘要 · Abstract (English)

Large language models perform well on high-resource pairs but are less reliable for Japanese-Chinese sentences containing noun-modifying clause constructions (NMCCs). This study evaluates a retrieval-augmented generation RAG+Prompt translation system that integrates linguistic analysis, embedding-based retrieval, prompt construction, and LLM generation without modifying the base model. The analysis module outputs A1 (inner vs. outer NMCC) and A2 (risk predictions: lexical choice/NMCC handling/word order/style/register); top-k = 5 similar Ja-Zh examples (L2 distance) and A1/A2 are inserted into an enhanced prompt. Using GPT-4o and a 66-sentence test set, we compare six knowledge-base sizes (0/100/200/500/1,000/2,000). Macro-averaged sentence-level BLEU (1-4-gram with brevity penalty; cased; Chinese at the character level) is the sole metric. Mean BLEU increases from 24.28 at 0 (RAG disabled) to 29.96 at 2,000 (+5.68; +23.4%). The upward trend holds across sizes, with larger knowledge bases yielding higher scores. We conclude that the RAG+Prompt translation system improves Ja-Zh translation of sentences containing NMCCs in an interpretable and auditable manner. Limitations include one base model, one metric, and reliance on published texts and commercial APIs; future work will broaden genres, language pairs, and evaluation metrics.

机器翻译提示工程RAG日语

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。