arXiv:2604.02513eess.SPcs.AI2026-04

用数学统一解释经典稀疏学习算法,并用神经网络学出更优的新算法。

Sparse Bayesian Learning Algorithms Revisited: From Learning Majorizers to Structured Algorithmic Learning using Neural Networks

论文配图:Sparse Bayesian Learning Algorithms Revisited: From Learning Majorizers to Structured Algorithmic Learning using Neural Networks
图 1 · 摘自论文原文
  • 基于极大化极小化原理,统一推导主流稀疏贝叶斯算法
  • 提出新型神经网络架构,在多种条件下优于传统方法
  • 模型对测量矩阵不敏感,具备零样本泛化能力

稀疏贝叶斯学习(SBL)是主流的稀疏信号恢复方法,但面对特定性能指标和问题时,难以预先选择最优算法。本文首次证明,最常用的SBL算法均可由极大化极小化(MM)原理推导,提供此前未知的收敛性保证。进一步发现,两种最流行的SBL更新规则均属于同一主导函数的下降步,揭示其深层一致性。基于此,我们在MM框架内扩展了算法类,并提出数据驱动的最优算法搜索方法。此外,突破传统框架,引入深度学习建模能力,设计新型神经网络架构,可从数据中学习更优的SBL更新规则。该架构复杂度不随测量矩阵维度增长,实现跨不同矩阵的泛化测试;对参数化字典,可在不同参数区间训练与测试。还展示了模型在未见测量矩阵上的零样本性能,且在不同快照数、信噪比及稀疏度下表现稳定。

原文摘要 · Abstract (English)

Sparse Bayesian Learning is one of the most popular sparse signal recovery methods, and various algorithms exist under the SBL paradigm. However, given a performance metric and a sparse recovery problem, it is difficult to know a-priori the best algorithm to choose. This difficulty is in part due to a lack of a unified framework to derive SBL algorithms. We address this issue by first showing that the most popular SBL algorithms can be derived using the majorization-minimization (MM) principle, providing hitherto unknown convergence guarantees to this class of SBL methods. Moreover, we show that the two most popular SBL update rules not only fall under the MM framework but are both valid descent steps for a common majorizer, revealing a deeper analytical compatibility between these algorithms. Using this insight and properties from MM theory we expand the class of SBL algorithms, and address finding the best SBL algorithm via data within the MM framework. Second, we go beyond the MM framework by introducing the powerful modeling capabilities of deep learning to further expand the class of SBL algorithms, aiming to learn a superior SBL update rule from data. We propose a novel deep learning architecture that can outperform the classical MM based ones across different sparse recovery problems. Our architecture's complexity does not scale with the measurement matrix dimension, hence providing a unique opportunity to test generalization capability across different matrices. For parameterized dictionaries, this invariance allows us to train and test the model across different parameter ranges. We also showcase our model's ability to learn a functional mapping by its zero-shot performance on unseen measurement matrices. Finally, we test our model's performance across different numbers of snapshots, signal-to-noise ratios, and sparsity levels.

稀疏学习贝叶斯神经网络优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。