arXiv:2601.01739cs.CLcs.AI2026-01被引 2

LG研发236B参数多语言大模型,推理仅激活230亿参数。

K-EXAONE Technical Report

  • 采用专家混合架构,总参数2360亿,推理时激活230亿。
  • 支持256K上下文长度,覆盖韩、英、西、德、日、越六种语言。
  • 性能媲美同规模开源模型,适合工业与科研应用。

本技术报告介绍由LG AI Research开发的大规模多语言语言模型K-EXAONE。K-EXAONE基于专家混合架构,总参数量达2360亿,推理时激活230亿参数。其支持256K token的上下文窗口,涵盖韩语、英语、西班牙语、德语、日语和越南语六种语言。我们在涵盖推理、智能体、通用能力、韩语及多语言能力的综合基准上评估了K-EXAONE。在各项评测中,其表现与同规模开源模型相当。K-EXAONE旨在推动人工智能造福生活,定位为面向广泛工业与科研应用的强大专有基础模型。

原文摘要 · Abstract (English)

This technical report presents K-EXAONE, a large-scale multilingual language model developed by LG AI Research. K-EXAONE is built on a Mixture-of-Experts architecture with 236B total parameters, activating 23B parameters during inference. It supports a 256K-token context window and covers six languages: Korean, English, Spanish, German, Japanese, and Vietnamese. We evaluate K-EXAONE on a comprehensive benchmark suite spanning reasoning, agentic, general, Korean, and multilingual abilities. Across these evaluations, K-EXAONE demonstrates performance comparable to open-weight models of similar size. K-EXAONE, designed to advance AI for a better life, is positioned as a powerful proprietary AI foundation model for a wide range of industrial and research applications.

多语言模型专家混合大模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。