arXiv:2602.15021astro-ph.SRastro-ph.GA2026-02中稿 · publication in ApJ被引 1

用简单神经网络实现低分辨率到中分辨率星谱的跨调查参数估计

Generalization from Low- to Moderate-Resolution Spectra with Neural Networks for Stellar Parameter Estimation: A Case Study with DESI

  • 用预训练多层感知机直接处理星谱,无需微调即可表现良好
  • 在金属丰富星体中,基于Transformer的嵌入效果更优,金属贫乏时反而不如直接训练
  • 不同参数需适配不同微调策略,简单模型已具竞争力

跨调查泛化是恒星光谱分析中的关键挑战,尤其在从低分辨率向中分辨率迁移时。本文以LAMOST低分辨率光谱(LRS)向DESI中分辨率光谱(MRS)迁移为例,研究预训练多层感知机(MLP)的性能。我们对MLP在LRS或其嵌入上进行预训练,并在DESI光谱上微调。对比了直接在光谱上训练与在基于Transformer的自监督基础模型生成的嵌入上训练的效果。评估了残差头微调、LoRA和全量微调等策略。结果表明,仅在LRS上预训练的MLP无需微调即表现优异,适度微调可进一步提升。铁元素丰度方面,高金属丰度([Fe/H] > -1.0)下,基于Transformer的嵌入有优势;但在金属贫乏区表现较差。最优微调策略依赖于具体恒星参数。研究显示,简单预训练的MLP已能实现强跨调查泛化,而光谱基础模型的作用仍需深入探索。

原文摘要 · Abstract (English)

Cross-survey generalization is a critical challenge in stellar spectral analysis, particularly in cases such as transferring from low- to moderate-resolution surveys. We investigate this problem using pre-trained models, focusing on simple neural networks such as multilayer perceptrons (MLPs), with a case study transferring from LAMOST low-resolution spectra (LRS) to DESI medium-resolution spectra (MRS). Specifically, we pre-train MLPs on either LRS or their embeddings and fine-tune them for application to DESI stellar spectra. We compare MLPs trained directly on spectra with those trained on embeddings derived from transformer-based models (self-supervised foundation models pre-trained for multiple downstream tasks). We also evaluate different fine-tuning strategies, including residual-head fine-tuning, LoRA, and full fine-tuning. We find that MLPs pre-trained on LAMOST LRS achieve strong performance, even without fine-tuning, and that modest fine-tuning with DESI spectra further improves the results. For iron abundance, embeddings from a transformer-based model yield advantages in the metal-rich ([Fe/H] > -1.0) regime, but underperform in the metal-poor regime compared to MLPs trained directly on LRS. We also show that the optimal fine-tuning strategy depends on the specific stellar parameter under consideration. These results highlight that simple pre-trained MLPs can provide competitive cross-survey generalization, while the role of spectral foundation models for cross-survey stellar parameter estimation requires further exploration.

星体参数估计跨调查泛化神经网络光谱分析

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。