arXiv:2412.04862cs.CL2024-12被引 58

EXAONE 3.5是面向真实场景的开源大模型,支持多尺寸部署。

EXAONE 3.5: Series of Large Language Models for Real-world Use Cases

  • 基于指令微调,适配真实任务场景
  • 在七项基准中表现最优,长文本理解能力领先
  • 适合科研与工业落地,提供2.4B~32B三种版本

本技术报告介绍了由LG AI Research开发并发布的EXAONE 3.5指令微调语言模型。该系列模型提供32B、7.8B和2.4B三种配置。其具备三大突出能力:1)在真实场景中表现出色的指令遵循能力,在七项基准测试中取得最高分;2)卓越的长上下文理解能力,在四项基准中表现最佳;3)在九项通用基准上与同规模先进开源模型相比具有竞争力。EXAONE 3.5对研究者完全开放,可从https://huggingface.co/LGAI-EXAONE下载。商业用途请通过LG AI Research官方联系方式[email protected]咨询。

原文摘要 · Abstract (English)

This technical report introduces the EXAONE 3.5 instruction-tuned language models, developed and released by LG AI Research. The EXAONE 3.5 language models are offered in three configurations: 32B, 7.8B, and 2.4B. These models feature several standout capabilities: 1) exceptional instruction following capabilities in real-world scenarios, achieving the highest scores across seven benchmarks, 2) outstanding long-context comprehension, attaining the top performance in four benchmarks, and 3) competitive results compared to state-of-the-art open models of similar sizes across nine general benchmarks. The EXAONE 3.5 language models are open to anyone for research purposes and can be downloaded from https://huggingface.co/LGAI-EXAONE. For commercial use, please reach out to the official contact point of LG AI Research: [email protected].

大模型指令微调开源模型长文本

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。