从缺失数据中高效学习高维高斯分布,解决非随机缺失问题。
Learning High-dimensional Gaussians from Censored Data
- 基于已知缺失模式设计高效学习算法
- 仅需多项式样本即可达到指定精度
- 适用于变量缺失不随机的现实场景
针对高维高斯数据中变量非随机缺失(MNAR)的问题,本文提出两种高效算法。在自编码场景下,假设每个坐标是否观测由一个已知集合决定,设计了使用 $poly(d, 1/ε)$ 样本即可在总变差距离上学习到目标高斯分布 $N(μ*, Σ*)$ 的算法,仅需任意两坐标同时被观测的概率足够高。在线性阈值场景下,缺失模式为 $S(y) = \{i : v_i^T y \leq b_i\}$,在条件缺失模式不罕见且任意小坐标子集观测概率充足的前提下,设计了高效的均值估计算法。结果在理论和实际应用中均有意义。
原文摘要 · Abstract (English)
We provide efficient algorithms for the problem of distribution learning from high-dimensional Gaussian data where in each sample, some of the variable values are missing. We suppose that the variables are missing not at random (MNAR). The missingness model, denoted by $S(y)$, is the function that maps any point $y$ in $R^d$ to the subsets of its coordinates that are seen. In this work, we assume that it is known. We study the following two settings: (i) Self-censoring: An observation $x$ is generated by first sampling the true value $y$ from a $d$-dimensional Gaussian $N(μ*, Σ*)$ with unknown $μ*$ and $Σ*$. For each coordinate $i$, there exists a set $S_i$ subseteq $R^d$ such that $x_i = y_i$ if and only if $y_i$ in $S_i$. Otherwise, $x_i$ is missing and takes a generic value (e.g., "?"). We design an algorithm that learns $N(μ*, Σ*)$ up to total variation (TV) distance epsilon, using $poly(d, 1/ε)$ samples, assuming only that each pair of coordinates is observed with sufficiently high probability. (ii) Linear thresholding: An observation $x$ is generated by first sampling $y$ from a $d$-dimensional Gaussian $N(μ*, Σ)$ with unknown $μ*$ and known $Σ$, and then applying the missingness model $S$ where $S(y) = {i in [d] : v_i^T y <= b_i}$ for some $v_1, ..., v_d$ in $R^d$ and $b_1, ..., b_d$ in $R$. We design an efficient mean estimation algorithm, assuming that none of the possible missingness patterns is very rare conditioned on the values of the observed coordinates and that any small subset of coordinates is observed with sufficiently high probability.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。