arXiv:2410.19390astro-ph.IMastro-ph.CO2024-10被引 2

提出CLAP方法,让星系光度红移估计更准确可信

CLAP. I. Resolving miscalibration for deep learning-based galaxy photometric redshift estimation

  • 用对比学习+K近邻校准深度学习输出的概率密度
  • 在多个数据集上显著提升校准精度且保持高效计算
  • 适合需要高可靠性红移估计的天体物理研究者

在缺乏光谱测量的情况下,获取准确校准的星系光度红移概率密度仍是挑战。深度学习判别模型虽能生成类概率输出并达到顶尖精度,但常因校准偏差导致预测结果与真实红移分布不符。本文提出一种新方法CLAP,结合监督对比学习(SCL)与k近邻(KNN),构建并校准原始概率密度估计,并通过重训练流程恢复端到端模型,可直接用于大规模成像数据。采用调和平均融合多组独立估计以提升精度。实验表明,CLAP同时具备深度学习的高精度与KNN的强校准能力,在校准性能上超越基准方法,且计算效率高。我们指出,校准偏差不仅源于认知不确定性,更受模型引入的数据实例间过度相关性影响;传统深度学习难以解决此问题,而CLAP具有更强鲁棒性。本研究为天体物理与宇宙学应用提供可靠的光度红移概率密度估计方案。这是CLAP系列的第一篇论文。

原文摘要 · Abstract (English)

Obtaining well-calibrated photometric redshift probability densities for galaxies without a spectroscopic measurement remains a challenge. Deep learning discriminative models, typically fed with multi-band galaxy images, can produce outputs that mimic probability densities and achieve state-of-the-art accuracy. However, such models may be affected by miscalibration that would result in discrepancies between the model outputs and the actual distributions of true redshifts. Our work develops a novel method called the Contrastive Learning and Adaptive KNN for Photometric Redshift (CLAP) that resolves this issue. It leverages supervised contrastive learning (SCL) and k-nearest neighbours (KNN) to construct and calibrate raw probability density estimates, and implements a refitting procedure to resume end-to-end discriminative models ready to produce final estimates for large-scale imaging data. The harmonic mean is adopted to combine an ensemble of estimates from multiple realisations for improving accuracy. Our experiments demonstrate that CLAP takes advantage of both deep learning and KNN, outperforming benchmark methods on the calibration of probability density estimates and retaining high accuracy and computational efficiency. With reference to CLAP, we point out that miscalibration is particularly sensitive to the method-induced excessive correlations among data instances in addition to the unaccounted-for epistemic uncertainties. Reducing the uncertainties may not guarantee the removal of miscalibration due to the presence of such excessive correlations, yet this is a problem for conventional deep learning methods rather than CLAP. These discussions underscore the robustness of CLAP for obtaining photometric redshift probability densities required by astrophysical and cosmological applications. This is the first paper in our series on CLAP.

红移估计深度学习校准天体物理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。