arXiv:2508.15763cs.LGcs.CL2025-08被引 17

Intern-S1是首个专注科学领域的多模态基础模型,显著提升开源模型在科研任务中的表现。

Intern-S1: A Scientific Multimodal Foundation Model

  • 构建多模态专家混合模型,用5T token持续预训练,其中2.5T来自科学数据
  • 在1000+任务上通过混合奖励机制实现在线强化学习,突破开源科学模型性能瓶颈
  • 在分子合成、晶体稳定性等专业任务上超越闭源模型,适合科研与AI交叉领域研究者

近年来,大量开源基础模型在热门领域取得显著进展,性能接近闭源模型。然而,在高价值但更具挑战性的科学专业领域,通用基础模型进展仍落后于专家模型,难以推动科学研究,开源与闭源模型间存在明显差距。为缩小这一鸿沟并迈向通用人工智能(AGI),我们提出Intern-S1,一个具备多科学模态理解与推理能力的专用通用模型。Intern-S1是参数总量2410亿、激活参数280亿的多模态专家混合(MoE)模型,持续预训练于5万亿标记符数据,其中超过2.5万亿标记符来自科学领域。后训练阶段,采用离线与在线强化学习(RL)结合的方式,在InternBootCamp中引入混合奖励(MoR)机制,协同优化超过1000项任务。通过算法、数据与训练系统的综合创新,Intern-S1在在线强化学习中实现顶尖性能。在综合性评估基准上,其在通用推理任务中表现优于其他开源模型,并在科学领域显著领先,甚至超越闭源先进模型,尤其在分子合成规划、反应条件预测、晶体热力学稳定性预测等专业任务中表现突出。模型已开源:https://huggingface.co/internlm/Intern-S1。

原文摘要 · Abstract (English)

In recent years, a plethora of open-source foundation models have emerged, achieving remarkable progress in some widely attended fields, with performance being quite close to that of closed-source models. However, in high-value but more challenging scientific professional fields, either the fields still rely on expert models, or the progress of general foundation models lags significantly compared to those in popular areas, far from sufficient for transforming scientific research and leaving substantial gap between open-source models and closed-source models in these scientific domains. To mitigate this gap and explore a step further toward Artificial General Intelligence (AGI), we introduce Intern-S1, a specialized generalist equipped with general understanding and reasoning capabilities with expertise to analyze multiple science modal data. Intern-S1 is a multimodal Mixture-of-Experts (MoE) model with 28 billion activated parameters and 241 billion total parameters, continually pre-trained on 5T tokens, including over 2.5T tokens from scientific domains. In the post-training stage, Intern-S1 undergoes offline and then online reinforcement learning (RL) in InternBootCamp, where we propose Mixture-of-Rewards (MoR) to synergize the RL training on more than 1000 tasks simultaneously. Through integrated innovations in algorithms, data, and training systems, Intern-S1 achieved top-tier performance in online RL training. On comprehensive evaluation benchmarks, Intern-S1 demonstrates competitive performance on general reasoning tasks among open-source models and significantly outperforms open-source models in scientific domains, surpassing closed-source state-of-the-art models in professional tasks, such as molecular synthesis planning, reaction condition prediction, predicting thermodynamic stabilities for crystals. Our models are available at https://huggingface.co/internlm/Intern-S1.

科学计算多模态强化学习开源模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。