自动化印尼语漫画翻译，提升跨语言阅读效率
Crossing Language Borders: A Pipeline for Indonesian Manhwa Translation
- 融合视觉识别与机器翻译，构建端到端漫画翻译流水线
- 在印尼语到英语翻译中达到高效准确，关键步骤表现良好
- 针对低资源语言设计，适合小语种漫画本地化需求
本项目开发了一套高效自动化方案，实现从印尼语到英语的漫画（Manhwa）翻译。流程结合计算机视觉、文本识别与自然语言处理技术，包括使用微调后的YOLOv5xu进行对话框检测，Tesseract进行OCR识别，以及微调后的MarianMT进行机器翻译。该方法有效替代传统人工翻译流程，显著节省时间和人力成本。不同于主流的日语到英语翻译研究，本工作聚焦于低资源语言的印尼语到英语翻译，解决了多语言漫画内容全球化传播中的语言壁垒问题。实验表明各环节均表现良好，整体系统能高效完成从印尼语到英语的漫画内容转换。
原文摘要 · Abstract (English)
In this project, we develop a practical and efficient solution for automating the Manhwa translation from Indonesian to English. Our approach combines computer vision, text recognition, and natural language processing techniques to streamline the traditionally manual process of Manhwa(Korean comics) translation. The pipeline includes fine-tuned YOLOv5xu for speech bubble detection, Tesseract for OCR and fine-tuned MarianMT for machine translation. By automating these steps, we aim to make Manhwa more accessible to a global audience while saving time and effort compared to manual translation methods. While most Manhwa translation efforts focus on Japanese-to-English, we focus on Indonesian-to-English translation to address the challenges of working with low-resource languages. Our model shows good results at each step and was able to translate from Indonesian to English efficiently.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。