首个专为新加坡多语种环境设计的语音文本大模型，提升本地语言识别与理解能力。
MERaLiON-AudioLLM: Bridging Audio and Language with Large Language Models
- 融合语音与文本处理，针对新加坡多语种方言和口音优化
- 在语音识别与任务理解上均取得显著提升
- 适合需要本地化多语言支持的AI应用开发者
我们提出MERaLiON-AudioLLM（Multimodal Empathetic Reasoning and Learning in One Network），首个专为新加坡多语种、多文化背景设计的语音-文本大模型。依托新加坡国家大语言模型资助计划开发，该模型整合先进语音与文本处理技术，有效应对本地口音与方言差异，在复杂多语言环境中显著提升可访问性与可用性。实验结果表明，模型在语音识别与特定任务理解方面均有明显改善，成为区域性AI应用的开创性解决方案。我们期望此次发布能为未来全球化框架下针对本地语言文化情境的模型设计树立典范。
原文摘要 · Abstract (English)
We introduce MERaLiON-AudioLLM (Multimodal Empathetic Reasoning and Learning in One Network), the first speech-text model tailored for Singapore's multilingual and multicultural landscape. Developed under the National Large Language Models Funding Initiative, Singapore, MERaLiON-AudioLLM integrates advanced speech and text processing to address the diverse linguistic nuances of local accents and dialects, enhancing accessibility and usability in complex, multilingual environments. Our results demonstrate improvements in both speech recognition and task-specific understanding, positioning MERaLiON-AudioLLM as a pioneering solution for region specific AI applications. We envision this release to set a precedent for future models designed to address localised linguistic and cultural contexts in a global framework.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。