arXiv:2602.15084physics.plasm-phcs.AI2026-02KDD被引 2

首个开源托卡马克等离子体动力学基础模型,支持多模态数据统一建模。

TokaMind: A Multi-Modal Transformer Foundation Model for Tokamak Plasma Dynamics

  • 基于多模态Transformer,融合时序、二维剖面和视频数据,支持缺失信号处理。
  • 在MAST基准上14项任务中13项超越最强基线,长时程预测效果显著提升。
  • 适合等离子体物理研究者与融合能源领域开发者,可快速适配新任务。

我们提出TokaMind,据我们所知首个面向托卡马克等离子体动力学的开源基础模型,基于多模态Transformer(MMT),并在公开的MAST数据集异构诊断数据上进行预训练。TokaMind支持多种数据模态(时序、2D剖面、视频)及不同采样率,具备鲁棒的缺失信号处理能力,并可通过选择性加载和冻结四个模型组件实现高效任务适配。为表示多模态信号,我们采用轻量级固定基离散余弦变换嵌入(DCT3D),并提供接口支持其他嵌入方式(如变分自编码器)。我们在近期提出的MAST基准TokaMark上评估,该基准包含14项具有异构重建与预测目标的任务。结果表明,微调后的TokaMind在除一项任务外的所有任务中均优于最强基线。相较于在相同训练轮次预算下从头训练同一架构,冷启动微调在高要求下游任务(如长时程预测与高维平衡目标)中优势最为明显。这些发现凸显了多模态预训练在托卡马克等离子体动力学中的价值,并为未来聚变建模任务提供了实用且可扩展的基础。训练代码与模型权重分别公开于github.com/UKAEA-IBM-STFC-Fusion-FMs/tokamind与huggingface.co/UKAEA-IBM-STFC。

原文摘要 · Abstract (English)

We present TokaMind, to our knowledge the first open-source foundation model for tokamak plasma dynamics, based on a Multi-Modal Transformer (MMT) and pretrained on heterogeneous diagnostics from the publicly available MAST dataset. TokaMind supports multiple data modalities (time-series, 2D profiles, and videos) with different sampling rates, robust missing-signal handling, and efficient task adaptation via selectively loading and freezing four model components. To represent multi-modal signals, we use a lightweight fixed-basis Discrete Cosine Transform embedding (DCT3D) and provide a clean interface for alternative embeddings (e.g., Variational Autoencoders). We evaluate TokaMind on the recently introduced MAST benchmark TokaMark, which comprises 14 tasks with heterogeneous reconstruction and forecasting objectives. Our results show that fine-tuned TokaMind outperforms the strongest benchmark baseline on all but one task. Compared with training the same architecture from scratch under a matched epoch budget, warm-start adaptation is most beneficial on demanding downstream settings, including long-horizon forecasting and high-dimensional equilibrium objectives. These findings highlight the value of multi-modal pretraining for tokamak plasma dynamics and provide a practical, extensible foundation for future fusion modeling tasks. Training code and model weights are publicly available at github.com/UKAEA-IBM-STFC-Fusion-FMs/tokamind and huggingface.co/UKAEA-IBM-STFC, respectively.

等离子体多模态基础模型聚变能源

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。