用Transformer+U-Net联合学习未知传感矩阵,实现稀疏信号高精度重建。
TRUST -- Transformer-Driven U-Net for Sparse Target Recovery
- 融合Transformer与U-Net,通过注意力捕捉长程依赖并引导解码器
- 在有限样本下实现优于传统方法的重构性能(SSIM/PSNR提升)
- 适合低采样率、传感矩阵未知的逆问题场景
在逆问题 $\bf y = Ax$ 背景下,稀疏恢复通过利用结构(尤其是稀疏性)实现了对病态或欠定系统的稳定求解。通过 $\ell_0$-或 $\ell_1$-范数正则化,可获得既符合观测 $\bf y$ 又具有简洁表示的解 $\bf x$,常具物理意义。本文解决传感矩阵 $\bf A$ 未知且仅有少量观测-目标对 $\{ \bf x,\bf y \}$ 的挑战性场景。提出新型神经架构 TRUST,将 Transformer 的注意力机制与 U-Net 解码路径结合,同时学习传感矩阵并重构稀疏信号。其基于 Transformer 的编码分支捕捉长程依赖并估计稀疏支撑,再引导 U-Net 式解码器通过多尺度特征融合精修重建。跨阶段跳跃连接使解码器可获取不同抽象层级的图像特征,提升重建质量。该混合架构结合全局上下文与局部细节,实现更准确、鲁棒的恢复。实验表明,TRUST 显著优于传统稀疏恢复方法和独立的 U-Net 模型,在 SSIM 与 PSNR 指标上表现更优,并有效抑制了深度学习逆求解中常见的幻觉伪影。
原文摘要 · Abstract (English)
In the context of inverse problems $\bf y = Ax$, sparse recovery offers a powerful paradigm shift by enabling the stable solution of ill-posed or underdetermined systems through the exploitation of structure, particularly sparsity. Sparse regularization techniques via $\ell_0$- or $\ell_1$-norm minimization encourage solutions $\bf x$ that are both consistent with observations $\bf y$ and parsimonious in representation, often yielding physically meaningful interpretations. In this work, we address the classical inverse problem under the challenging condition where the sensing operator $\bf A$ is unknown and only a limited set of observation-target pairs $\{ \bf x,\bf y \}$ is available. We propose a novel neural architecture, TRUST, that integrates the attention mechanism of Transformers with the decoder pathway of a UNet to simultaneously learn the sensing operator and reconstruct the sparse signal. The TRUST model incorporates a Transformer-based encoding branch to capture long-range dependencies and estimate sparse support, which then guides a U-Net-style decoder to refine reconstruction through multiscale feature integration. The skip connections between the transformer stages and the decoder not only enhance image quality but also enable the decoder to access image features at different levels of abstraction. This hybrid architecture enables more accurate and robust recovery by combining global context with local details. Experimental results demonstrate that TRUST significantly outperforms traditional sparse recovery methods and standalone U-Net models, achieving superior performance in SSIM and PSNR metrics while effectively suppressing hallucination artifacts that commonly plague deep learning-based inverse solvers.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。