提出无需训练的超小模型,实现快速高精度压缩感知重建。
Training-free Ultra Small Model for Universal Sparse Reconstruction in Compressed Sensing
- 用极少量参数的神经网络直接学习信号系数,实现免训练重建。
- 在大规模数据上效率提升100至1000倍,图像重建结构相似度提升292%。
- 适合资源受限或需可解释性的医学、传感等场景,兼具通用性与可解释性。
近年来预训练大模型受到广泛关注,但在需要高可解释性或资源受限的应用(如物理传感、医学成像、生物信息学)中面临挑战。压缩感知(CS)是支撑这些应用突破的重要理论,但作为典型的欠定线性系统,传统迭代方法在处理大规模数据时稀疏重建耗时过长。当前基于深度展开的AI方法难以替代,因预训练模型泛化能力差且缺乏可解释性。本文提出一种超小神经模型——系数学习(CL),无需训练即可实现快速稀疏重建,同时保持传统迭代方法的通用性与可解释性,并能融入先验知识。在长度为 $n$ 的信号中,仅需 $n$ 个可训练参数。构建案例模型 CLOMP 进行评估。实验覆盖一维、二维合成与真实信号,显著提升效率与精度。相比代表性迭代方法,CLOMP 在大规模数据上效率提升100至1000倍。在8个不同图像数据集上,采样率分别为0.1、0.3、0.5时,结构相似性指数分别提升292%、98%、45%。本方法有望真正将压缩感知重建带入人工智能时代,惠及依赖稀疏解的各类欠定线性系统。
原文摘要 · Abstract (English)
Pre-trained large models attract widespread attention in recent years, but they face challenges in applications that require high interpretability or have limited resources, such as physical sensing, medical imaging, and bioinformatics. Compressed Sensing (CS) is a well-proved theory that drives many recent breakthroughs in these applications. However, as a typical under-determined linear system, CS suffers from excessively long sparse reconstruction times when using traditional iterative methods, particularly with large-scale data. Current AI methods like deep unfolding fail to substitute them because pre-trained models exhibit poor generality beyond their training conditions and dataset distributions, or lack interpretability. Instead of following the big model fervor, this paper proposes ultra-small artificial neural models called coefficients learning (CL), enabling training-free and rapid sparse reconstruction while perfectly inheriting the generality and interpretability of traditional iterative methods, bringing new feature of incorporating prior knowledges. In CL, a signal of length $n$ only needs a minimal of $n$ trainable parameters. A case study model called CLOMP is implemented for evaluation. Experiments are conducted on both synthetic and real one-dimensional and two-dimensional signals, demonstrating significant improvements in efficiency and accuracy. Compared to representative iterative methods, CLOMP improves efficiency by 100 to 1000 folds for large-scale data. Test results on eight diverse image datasets indicate that CLOMP improves structural similarity index by 292%, 98%, 45% for sampling rates of 0.1, 0.3, 0.5, respectively. We believe this method can truly usher CS reconstruction into the AI era, benefiting countless under-determined linear systems that rely on sparse solution.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。