用多帧图像和随机优化,让无训练数据的天文图像修复更稳定清晰。
DIPLI: Deep Image Prior Lucky Imaging for Blind Astronomical Image Restoration
- 通过多帧叠加与随机梯度动力学,克服单图修复易过拟合的问题。
- 合成数据上感知质量优于90%场景,真实图像保留细节抑制噪声。
- 适合缺乏标注数据的天文成像,尤其对太阳系天体修复效果好。
现代图像修复与超分辨率方法依赖深度学习,但其通常需大量标注数据,而天体摄影中极少具备此类数据。深度图像先验(DIP)虽可无需训练直接优化单图,但常出现过拟合、伪影和不稳定问题。本文提出DIPLI框架,专为高对比度、解析度高的天体目标设计,将单帧处理扩展为多帧处理,结合反向投影技术与TVNet估计密集光流,并以随机梯度朗之万动力学(SGLD)实现蒙特卡洛估计,替代确定性预测。在含真实标签的合成数据上,对比原始DIP、基于Transformer的RVRT及基于扩散模型的DiffIR2VR-Zero,DIPLI在12组中的12次LPIPS与10组中的10次DISTS表现最优;而DiffIR2VR-Zero在9/12组的PSNR与8/12组的SSIM上领先,符合图像修复中感知与失真间的经典权衡。在真实天文数据上,相比传统幸运成像,仅需7-13帧即可完成修复,远少于数千帧需求,且避免标准DIP所需的早停机制。对太阳系天体的真实数据定性评估显示,该方法在无真实标签、领域偏移严重的条件下仍能有效保留精细结构并抑制噪声与伪影。
原文摘要 · Abstract (English)
Modern image restoration and super-resolution methods utilize deep learning due to its superior performance compared to traditional algorithms. However, deep learning typically requires large labeled training datasets, which are rarely available in astrophotography. Deep Image Prior (DIP) bypasses this constraint by performing unsupervised optimization on a single image without training data; however, DIP often suffers from overfitting, artifact generation, and instability. This work proposes DIPLI - a framework designed specifically for resolved, high-contrast astronomical targets that shifts from single-frame to multi-frame processing using the Back Projection technique, combined with dense optical flow estimation via the TVNet model, and replaces deterministic predictions with Monte Carlo estimation obtained through Stochastic Gradient Langevin Dynamics (SGLD). A comprehensive evaluation compares the method against the original DIP, the transformer-based model RVRT, and the diffusion-based model DiffIR2VR-Zero on synthetic data with ground truth, while comparing qualitatively against Lucky Imaging on real astronomical data. On synthetic datasets, DIPLI achieves the best perceptual fidelity scores (LPIPS in 12/12 and DISTS in 10/12 scenarios), while the diffusion-based DiffIR2VR-Zero achieves the best pixel-level distortion scores (PSNR in 9/12 and SSIM in 8/12 scenarios), consistent with the well-known perceptual-distortion trade-off in image restoration. Compared to classical Lucky Imaging, the model requires far fewer input frames (7-13 versus thousands) and avoids the need for early stopping that limits standard DIP. Qualitative evaluation on real-world data of resolved solar-system objects, where ground truth is unavailable and domain shifts typically hinder generalization, suggests that the method appears to preserve fine detail while suppressing noise and artifacts.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。