改进深度学习成像模型R2D2,提升天文射电图像重建的精度与鲁棒性。
Toward a Robust R2D2 Paradigm for Radio-interferometric Imaging: Revisiting Deep Neural Network Training and Architecture
- 通过随机化采样时间与多组观测配置增强训练泛化能力。
- 基于噪声水平自动停止迭代,提升效率并优化数据保真度。
- 采用新架构U-WDSR,融合密集连接与低秩卷积,提升特征复用与重建精度。
R2D2系列深度神经网络用于射电干涉成像,可视为一种学习版的CLEAN算法,其微循环被DNN替代。本文从级数收敛性、训练方法与网络结构三方面重审R2D2,以提升其在训练条件外的泛化能力、高数据保真度及认知不确定性建模。首先,在保持望远镜特异性训练的基础上,引入随机傅里叶采样积分时间、多扫描多噪声配置及像素分辨率与可见度加权方案的变化。其次,提出以数据残差与噪声兼容为收敛标准,而非使用全部DNN,从而降低计算成本并精炼训练过程。第三,将原R2D2中的早期U-Net替换为新型架构U-WDSR,融合宽激活、密集跳接、权重归一化与低秩卷积,强化特征复用与重建精度。此前,R2D2在固定512×512分辨率下针对甚大阵列(VLA)进行单色强度成像训练。在广泛逆问题模拟与真实数据案例研究中,新R2D2模型始终优于旧版本,在图像质量、数据保真度与认知不确定性方面表现更佳。
原文摘要 · Abstract (English)
The R2D2 Deep Neural Network (DNN) series was recently introduced for image formation in radio interferometry. It can be understood as a learned version of CLEAN, whose minor cycles are substituted with DNNs. We revisit R2D2 on the grounds of series convergence, training methodology, and DNN architecture, improving its robustness in terms of generalizability beyond training conditions, capability to deliver high data fidelity, and epistemic uncertainty. First, while still focusing on telescope-specific training, we enhance the learning process by randomizing Fourier sampling integration times, incorporating multiscan multinoise configurations, and varying imaging settings, including pixel resolution and visibility-weighting scheme. Second, we introduce a convergence criterion whereby the reconstruction process stops when the data residual is compatible with noise, rather than simply using all available DNNs. This not only increases the reconstruction efficiency by reducing its computational cost, but also refines training by pruning out the data/image pairs for which optimal data fidelity is reached before training the next DNN. Third, we substitute R2D2's early U-Net DNN with a novel architecture (U-WDSR) combining U-Net and WDSR, which leverages wide activation, dense skip connections, weight normalization, and low-rank convolution to improve feature reuse and reconstruction precision. As previously, R2D2 was trained for monochromatic intensity imaging with the Very Large Array at fixed $512 \times 512$ image size. Simulations on a wide range of inverse problems and a case study on real data reveal that the new R2D2 model consistently outperforms its earlier version in image reconstruction quality, data fidelity, and epistemic uncertainty.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。