arXiv:2510.24215cs.ITcs.LG2025-10

揭示稀疏对抗性噪声下线性测量的鲁棒恢复机制

Robustness to Sparse Adversarial Corruption in Arbitrary Linear Measurements: Beyond Exact Recovery

  • 提出统一恢复框架,基于矩阵行空间交集定义可恢复信息
  • 证明最小0-范数误差解必属于重构集合,实现构造性恢复
  • 发现高斯矩阵存在精确与平凡恢复的尖锐相变边界

在稀疏对抗性扰动下的线性测量恢复通常被表述为精确恢复问题:寻找矩阵A的结构条件(如受限等距性)以保证从y = Ax* + e中唯一恢复x*,其中e的0-范数不超过q。然而,一旦精确恢复失败,此类保证便失效。本文研究任意A∈ℝ^{m×n}和任意q-稀疏扰动e下,能被一致恢复的x*信息。我们证明该信息恰好为x* + ker(U),其中U是删除任意2q行后所有子矩阵行空间交集的正交投影。这阐明了矩阵行结构如何决定稀疏扰动下的精确、部分或仅平凡恢复。进一步证明,任一最小化‖y - Ax‖₀的x必属于x* + ker(U),从而给出可构造的恢复方法。对于独立同分布高斯矩阵,我们建立精确与平凡恢复之间的尖锐相变。最后简要说明两个应用:鲁棒网络探查与过采样DCT信号重建。

原文摘要 · Abstract (English)

Recovery from linear measurements under sparse adversarial corruption is typically formulated as an exact-recovery problem: one seeks structural conditions on $\mathbf{A}$ (e.g., restricted isometry property) guaranteeing unique recovery of $\mathbf{x}^\star$ from $\mathbf{y} = \mathbf{A}\mathbf{x}^\star + \mathbf{e}$ with $\|\mathbf{e}\|_0 \leq q$. However, these guarantees provide no guidance once exact recovery fails. This limitation obscures simple robustness phenomena -- for instance, repeated rows in $\mathbf{A}$ can preserve nontrivial information about $\mathbf{x}^\star$ under sparse corruption. In this paper, we study what information about $\mathbf{x}^\star$ can be \emph{uniformly} recovered from $\mathbf{y} = \mathbf{A}\mathbf{x}^\star + \mathbf{e}$ for arbitrary $\mathbf{A}\in\mathbb{R}^{m\times n}$ and \emph{any} $q$-sparse $\mathbf{e}$. We show that the robust information is precisely $\mathbf{x}^\star + \ker(\mathbf{U})$, where $\mathbf{U}$ is the orthogonal projection onto the intersection of rowspaces of all submatrices of $\mathbf{A}$ obtained by deleting $2q$ rows. This clarifies how the row structure of $\mathbf{A}$ governs whether a $q$-sparse corruption allows exact, partial, or only trivial recovery. We further prove every $\mathbf{x}$ minimizing $\|\mathbf{y} - \mathbf{A} \mathbf{x}\|_0$ belongs to $\mathbf{x}^\star + \ker(\mathbf{U})$, yielding a constructive approach to recover this set. For i.i.d. Gaussian matrices, we establish a sharp phase transition between exact and trivial recovery. We sketch two applications: robust network tomography and signal reconstruction from oversampled DCT.

压缩感知鲁棒恢复稀疏噪声矩阵结构

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。