arXiv:2607.10618stat.MLcs.LG2026-07

用非凸正则化实现稀疏信号的高精度非线性观测重构

Demixing Sparse Signals from Nonlinear Observations using Generalized Non-convex Regularization

论文配图:Demixing Sparse Signals from Nonlinear Observations using Generalized Non-convex Regularization
图 1 · 摘自论文原文
  • 结合鲁棒损失与非凸惩罚项,提升信号分离稳定性
  • 在低采样率下实现近似最优误差界,抗重尾噪声
  • 适用于未知单调映射场景,适合信号处理与成像领域

我们研究从少量非线性观测中恢复一对稀疏向量的问题:$y_i=g(\inner{\ba_i}{\bPhi\bw^\ast+\bPsi\bz^\ast})+e_i$,$i=1,\dots,m$,其中 $m\ll n$,且存在相干性较弱的正交基 $\bPhi,\bPsi$、标量链接函数 $g$ 及可能具有重尾或污染特征的噪声 $e_i$。本文提出一种基于正则化的框架,融合了霍伯器化数据保真项与广义折叠凹惩罚(SCAD、MCP),并设计了一种带回溯的两块交替近似算法(NLD-PALM),其整个迭代序列在Kurdyka--Łojasiewicz条件下可证明收敛至临界点,具有局部线性收敛速率。统计层面,通过精确符号确定分解建立霍伯器化非线性损失的受限强凸性,推导出估计误差界为 $σ\sqrt{s\log(n)/m}$,该界在每个局部驻点均成立;在beta-min条件下,获得不含 $\log n$ 项且无收缩偏差的最优率 $σ\sqrt{s/m}$;并通过线性代理与裁剪的Plan--Vershynin去耦技术,实现了对未知单调链接函数的对等恢复。该估计器无需知道稀疏度,且仅需对称噪声具有有限方差即可保证理论性质。实验在 $n=512$ 下采用固定数据驱动正则化规则,显示其相变提前于凸 $\ell_1$ 分离与贪心硬阈值基线,在5%粗大异常值下比平方损失估计精度高出35倍,并成功分离了经饱和放大器观测的尖峰加背景信号。

原文摘要 · Abstract (English)

We consider the recovery of a pair of sparse vectors from a limited number of nonlinear observations of their superposition: $y_i=g(\inner{\ba_i}{\bPhi\bw^\ast+\bPsi\bz^\ast})+e_i$, $i=1,\dots,m$, with $m\ll n$, incoherent orthonormal bases $\bPhi,\bPsi$, a scalar link $g$, and noise $e_i$ that may be heavy-tailed or contaminated. We propose a regularization-based framework combining a Huberized data fidelity with generalized folded-concave penalties (SCAD, MCP), and a two-block proximal alternating algorithm with backtracking (NLD-PALM) whose whole iterate sequence provably converges to critical points under the Kurdyka--Łojasiewicz property, with local linear rates. On the statistical side we establish restricted strong convexity of the Huberized nonlinear loss through an exact sign-definite decomposition, and derive estimation error bounds of order $σ\sqrt{s\log(n)/m}$ that hold at \emph{every} localized stationary point, an oracle rate $σ\sqrt{s/m}$ free of $\log n$ and shrinkage bias under a beta-min condition, and a co-equal recovery theorem for \emph{unknown} monotone links via a linear surrogate and a clipped Plan--Vershynin decoupling. The estimator requires no knowledge of the sparsity levels, and its guarantees hold under symmetric noise with only finite variance. Experiments at $n=512$ under a frozen data-driven regularization rule show an earlier phase transition than convex $\ell_1$ demixing and greedy hard-thresholding baselines, a $35\times$ accuracy advantage over squared-loss estimation under $5\%$ gross outliers, and successful demixing of spike-plus-background signals observed through a saturating amplifier.

信号分离非凸优化稀疏恢复鲁棒估计

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。