arXiv:2608.26354astro-ph.COastro-ph.IM2026-08

用预训练视觉模型实现跨模拟器精准宇宙再电离参数推断

Cross-simulator transfer with foundation model summaries: Towards robust SKA-era reionization inference

论文配图:Cross-simulator transfer with foundation model summaries: Towards robust SKA-era reionization inference
图 1 · 摘自论文原文
  • 自监督预训练ViT从快速近似模拟中学习通用数据摘要
  • 仅需2.6倍少的高精度模拟,即达最优参数估计精度
  • 适合需要抗模拟误差与噪声干扰的下一代射电天文研究

基于模拟的推断(SBI)在参数估计中易受模型偏差影响:在特定前向模型上训练的神经摘要和密度估计器通常无法应用于其他模型或真实观测数据。我们证明,一种在快速近似模拟上无标签自监督预训练的视觉变压器(ViT),能生成可迁移的数据摘要,在不同模拟间具有泛化能力。无需重训,该模型可作为冻结编码器,直接用于解析显式辐射传输的全新模拟——其从未见过相关数据或参数。以21cm宇宙学为例,SKATR是一种通过联合嵌入预测架构(JEPA)预训练的ViT,作为未来平方公里阵列(SKA)测量的再电离推断基础模型:它在67,000个低成本、无噪声的半数值21cmFAST光锥上预训练一次,随后冻结,应用于流体动力学模拟的Loreli II光锥,通过轻量级条件流匹配头推断五个天体物理参数;编码器全程未接触Loreli数据、参数或任何噪声。对比实验显示,SKATR在所有五项参数上均获得最精确且校准最佳的后验分布,精度媲美全监督域内基线,但仅需2.6倍更少的辐射传输模拟。在真实SKA AA*噪声条件下,唯有SKATR保持同时准确、信息丰富且校准良好,优于在噪声数据上从零重训的监督基线。因此,对计算高效的半数值模拟进行自监督预训练,是实现校准、模拟无关与噪声无关的SKA时代再电离推断的可行路径。

原文摘要 · Abstract (English)

Simulation-based inference (SBI) for parameter estimation is vulnerable to model misspecification: neural summaries and density estimators trained on a specific forward model typically fail when applied to data drawn from another model, or from real observations, and no training simulator can capture the full observational pipeline of a real measurement exactly. We show that a self-supervised Vision Transformer (ViT), pretrained label-free on a fast approximate simulator, produces transferable data summaries that generalize across simulators. Without retraining, it can be reused as a frozen encoder to infer astrophysical parameters from a completely different simulator that resolves the radiative transfer explicitly, on which it has never seen either data or parameters. As a concrete use case in 21cm cosmology, SKATR, a ViT pretrained with a Joint Embedding Predictive Architecture (JEPA), serves as a foundation model for reionization inference from upcoming SKA measurements: SKATR is pretrained once on 67k low-cost, noiseless semi-numerical 21cmFAST lightcones, then frozen and applied to hydrodynamical Loreli II lightcones, where a lightweight conditional flow matching head infers five astrophysical parameters; the encoder is never shown Loreli data, its parameters, or any noise. In our comparison, SKATR yields the most precise and best-calibrated posteriors across all five parameters, matching the accuracy of the fully-supervised in-domain baseline while requiring 2.6x fewer radiative-transfer simulations. Under realistic SKA AA* noise, only SKATR remains simultaneously accurate, informative, and calibrated, outperforming even a supervised baseline retrained from scratch on noisy data. Self-supervised pretraining on computationally efficient semi-numerical simulations is therefore a viable route to calibrated, simulator- and noise-agnostic reionization inference for the SKA-era.

宇宙学21cm探测自监督学习基础模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。