大模型能读文献、用工具、长期科研,还支持快速专业适配。
Intern-S2-Preview: Scientific Agentic Foundation Model

- 先训多模态科学文档,再用强化学习让模型自主规划任务。
- 在多个科学任务上表现领先,生物指令任务得分提升3.4分。
- 可不改主模型直接接入小模块,快速适应新领域。
科学发现日益依赖能够处理异构模态证据、与科学工具和环境交互,并在长任务周期中持续推进的AI系统。我们提出Intern-S2-Preview系列科学代理基础模型,支持多模态科学理解、推理、生成及长周期任务。训练流程始于对渲染的科学文档、交错图文数据和多样化科学语料的多模态预训练。从预训练检查点出发,采用统一后训练流程,包括监督微调、可扩展多任务强化学习(RL)、黑盒与白盒代理强化学习,以及在线策略蒸馏。该流程配备多项实用技术以提升回放与训练稳定性效率,如部分回放结合离策略修正、自适应长度正则化、在线推测解码、鲁棒多任务优化,以及面向代理任务的轨迹感知经验整合。架构层面,Intern-S2-Preview-397B将时间序列建模从高效长序列理解拓展至数值预测;同时,独立设计的Memory Decoder作为记忆增强路径,可在不修改冻结的397B主干的情况下实现快速科学专业化。在科学、多模态、代理及通用基准上的评估显示,Intern-S2-Preview-397B在多个场景下达到竞争性或领先性能。时间序列模块显著提升在SciTS上的科学信号理解与预测能力,而独立的Intern-MemDec-4B扩展使Biology-Instructions平均得分从56.92提升至60.32,且无需改动397B主干。
原文摘要 · Abstract (English)
Scientific discovery increasingly requires AI systems that can reason over scientific evidence of heterogeneous modalities, interact with scientific tools and environments, and sustain progress across long task horizons. We present Intern-S2-Preview, a series of scientific agentic foundation models designed to support multimodal scientific understanding, reasoning, generation, and long-horizon tasks. The training pipeline begins with scientific multimodal pre-training over rendered scientific documents, interleaved image-text data, and diverse scientific corpora. Starting from the pretrained checkpoint, we apply a unified post-training pipeline consisting of supervised fine-tuning, scalable multi-task reinforcement learning (RL), black- and white-box agentic RL, and on-policy distillation. This pipeline is supported by practical techniques that improve rollout and training stability and efficiency, including partial rollout with off-policy correction, adaptive length regularization, online speculative decoding, robust multi-task optimization, and trace-aware experience assembly for agentic tasks. At the architecture level, Intern-S2-Preview-397B extends time series modelling from efficient long-sequence understanding to numerical forecasting, while Memory Decoder is studied as a separate memory-augmented path for rapid scientific specialization without modifying the frozen 397B backbone. Evaluations across scientific, multimodal, agentic, and general-purpose benchmarks show that Intern-S2-Preview-397B achieves competitive or leading results in multiple settings. The time series modules improve scientific signal understanding and forecasting on SciTS, while the separate Intern-MemDec-4B extension improves the Biology-Instructions average score from 56.92 to 60.32 without modifying the frozen 397B backbone.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。