提出一种可控制适应数据的稀疏变换学习方法,兼顾高效与精准。
Learning Doubly Sparse Explicitly Conditioned Transforms

- 将固定基矩阵与稀疏自适应分量相乘构造变换
- 在双稀疏问题上达到当前最优性能,计算成本更低
- 适合需要快速稳定变换的信号处理场景
寻找自然信号具有特定稀疏结构的便利表示空间,是近年来研究的重要目标,其应用涵盖数据压缩、降噪和特征提取。尽管如DFT或DCT等经典解析变换已具备高效算法和鲁棒稀疏表示能力,但其假设固定的先验知识,难以准确捕捉特定信号类别的结构。为此,文献引入数据自适应的可学习变换,以减小变换域中的残差项。近期研究指出,条件数是该场景下的良好度量指标,理想结果需在泛化能力与最小近似误差间取得平衡。受此启发,本文提出一种结构化、显式条件化的变换学习方法,由固定基矩阵与可调稀疏自适应分量的乘积构成。该方法旨在保留快速、稳定的解析变换优势的同时,引入可控的数据适应性。目前未发现与此具体形式相关的文献,表明其新颖性。所提算法基于不精确邻近法框架,利用新推导的闭式投影算子。实验表明,在双稀疏变换学习任务中达到当前最优性能,且相比稠密变体具有显著更低的计算开销,有时收敛更快,并更有效避免劣质局部极小值。
原文摘要 · Abstract (English)
Finding convenient spaces in which certain hypotheses regarding an assumed sparse structure of natural signals hold true has become a desirable result in recent research, its implications being reflected in areas such as data compression, noise reduction and feature extraction. While the extensively used analytical transforms, such as DFT or DCT, already provide efficient algorithms and robust sparse representations, they assume a fixed prior about the data, failing to accurately capture the specific structure of more restrictive classes of signals. To address this, the concept of a data-adaptive, learnt transform has been introduced in the literature, allowing for the reduction of a residual term in the transform domain. More recent studies have shown that the condition number serves as a good metric in this context, where the desired outcome alternates between a generalizing tendency and one that achieves minimal approximation error. Motivated by these considerations, we introduce the learning of a structured, explicitly conditioned transform formulated as the product of a fixed canonical matrix and a refining data-adaptive sparse component. This approach seeks to preserve the advantages of fast and stable analytical transforms, while introducing controllable adaptivity to the data. No references that concern this specific formulation have been identified so far, indicating its novelty. The proposed algorithm is motivated within the framework of inexact proximal methods, leveraging a newly derived closed-form projection operator. Empirical observations demonstrate state-of-the-art results on the doubly sparse transform learning problem and comparable performance with its dense variant at significantly lower computational costs and sometimes faster convergence and better avoidance of bad local minima.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。