用概率门控方法提升稀疏逆问题的重建精度与稳定性
Variational Garrote for Sparse Inverse Problems
- 引入变分剪枝法,通过二元门控变量逼近L0正则化
- 在欠定场景下,最小泛化误差更低且结果更稳定
- 适合需要精准支持恢复的稀疏信号重建任务
稀疏正则化在处理不完整或受损测量的逆问题中起核心作用。不同正则化对应不同的信号结构先验,重建性能取决于先验与数据内在稀疏性的匹配程度。本文通过对比传统L1正则化与变分剪枝(VG)方法——一种通过变分二元门控变量近似L0稀疏性的概率方法——研究稀疏先验的影响。构建统一实验框架,涵盖信号重采样、去噪及稀疏视角计算机断层扫描等任务。为实现不同参数化模型的可比性,广泛调节正则化强度,并通过训练-泛化误差曲线分析重建行为。实验揭示了各类任务下的典型偏差-方差权衡模式,表明在强欠定情形下,当准确支持恢复至关重要时,VG常能达到更低的最小泛化误差并表现出更强稳定性。结果表明,接近尖峰-平板结构的稀疏先验在底层系数分布高度稀疏时具有优势。研究强调了稀疏逆问题中先验与数据对齐的重要性,并为变分L0类方法在不同信息瓶颈下的表现提供了实证洞察。
原文摘要 · Abstract (English)
Sparse regularization plays a central role in solving inverse problems arising from incomplete or corrupted measurements. Different regularizers correspond to different prior assumptions about the structure of the unknown signal, and reconstruction performance depends on how well these priors match the intrinsic sparsity of the data. This work investigates the effect of sparsity priors in inverse problems by comparing conventional L1 regularization with the Variational Garrote (VG), a probabilistic method that approximates L0 sparsity through variational binary gating variables. A unified experimental framework is constructed across multiple reconstruction tasks including signal resampling, signal denoising, and sparse-view computed tomography. To enable consistent comparison across models with different parameterizations, regularization strength is swept across wide ranges and reconstruction behavior is analyzed through train-generalization error curves. Experiments reveal characteristic bias-variance tradeoff patterns across tasks and demonstrate that VG frequently achieves lower minimum generalization error and improved stability in strongly underdetermined regimes where accurate support recovery is critical. These results suggest that sparsity priors closer to spike-and-slab structure can provide advantages when the underlying coefficient distribution is strongly sparse. The study highlights the importance of prior-data alignment in sparse inverse problems and provides empirical insights into the behavior of variational L0-type methods across different information bottlenecks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。