arXiv:2607.07468stat.MLcs.LG2026-07

通过 $oldsymbol{oldsymbol{ ext{ℓ}^1}}$ 正则化实现稀疏函数的高精度重建。

Statistical inverse learning and $\ell^1$-regularization

论文配图:Statistical inverse learning and $\ell^1$-regularization
图 1 · 摘自论文原文
  • 用 ℓ¹ 正则化最小化经验风险,构建可信赖的稀疏函数恢复方法。
  • 在预测和 ℓ¹ 重构范数下,收敛速率达到最优,依赖光滑性参数 $r$ 与有效维数指数 $b$。
  • 适用于椭圆方程反演、稀疏断层扫描等实际问题,理论结果可直接落地。

我们研究在统计逆学习框架下,从有限、噪声且间接的观测中恢复稀疏函数的问题。未知函数被建模为 ℓ¹ 空间中的元素,观测由可能非线性的前向算子 $A: oldsymbol{ ext{ℓ}^1} o H$ 生成,其中 $H$ 是向量值再生核希尔伯特空间。本文提出一种 ℓ¹-正则化的经验风险最小化器,并对其统计性质进行理论分析。在温和假设下,建立了几乎必然一致性和非渐近高概率收敛速率,分别在预测和 ℓ¹ 重构范数中成立。收敛速率依赖于源光滑性参数 $r$(由变分源条件刻画)和有效维度指数 $b$(描述协方差算子的多项式谱衰减)。进一步证明了匹配的极小极大下界,表明所获速率是紧致最优的。为连接理论与实用稀疏模型,考虑形式为 $A = G igcirc S$ 的有限光滑算子,其中 $S$ 为合成算子,证明逼近空间假设蕴含所需的变分源条件。特别地,证明了属于逼近空间 $k_t$ 等价于最佳 $n$-项逼近误差的多项式衰减。最后,验证了两个代表性反问题的假设:椭圆方程中反应系数识别和稀疏计算机断层扫描。针对滤波拉东变换,导出了显式的有效维度渐近表达,从而给出标准图像模型和稀疏化系统下的具体收敛速率。

原文摘要 · Abstract (English)

We study the recovery of sparse functions from finite, noisy, and indirect observations in the framework of statistical inverse learning. The unknown is modeled as an element of $\ell^1$, and observations are generated through a possibly nonlinear forward operator $A:\ell^1\to H$, where $H$ is a vector-valued reproducing kernel Hilbert space. We propose an $\ell^1$-regularized empirical risk minimizer and develop a theoretical analysis of its statistical properties. Under mild assumptions, we establish almost-sure consistency and derive non-asymptotic high-probability convergence rates in both the prediction and $\ell^1$ reconstruction norms. The rates depend on the source smoothness parameter $r$, characterized by a variational source condition, and the effective dimension exponent $b$, describing the polynomial spectral decay of the covariance operator. We further prove matching minimax lower bounds, showing that the obtained convergence rates are optimal. To relate the theory to practical sparsity models, we consider finitely smoothing operators of the form $A=G\circ S$, where $S$ is a synthesis operator, and show that approximation-space assumptions imply the required variational source conditions. In particular, we prove that membership in the approximation space $k_t$ is equivalent to polynomial decay of the best $n$-term approximation error. Finally, we verify the assumptions for two representative inverse problems: reaction coefficient identification in elliptic PDEs and sparse computed tomography. For filtered Radon transforms, we derive explicit effective-dimension asymptotics, yielding concrete convergence rates for standard image models and sparsifying systems.

反问题稀疏恢复ℓ¹正则化统计学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。