arXiv:2410.02025math.STcs.AI2024-10ICML被引 4

用似然方法研究高维分布回归,突破维度诅咒。

A Likelihood Based Approach to Distribution Regression Using Conditional Deep Generative Models

  • 基于似然的条件生成模型,通过小噪声扰动提升稳定性。
  • 估计误差率仅依赖于真实条件分布的内在维数与光滑性。
  • 适合处理低维流形上聚集的复杂高维数据,如医学影像。

本文在分布回归的统计框架下,研究了条件深度生成模型的大样本性质,其中响应变量位于高维空间但集中在潜在的低维流形上。我们分析了基于似然的估计方法,推导出筛子最大似然估计器(sieve MLE)在Hellinger(Wasserstein)度量下对给定预测变量的条件分布及其退化版本的收敛速率。该速率仅依赖于真实条件分布的内在维数和光滑性。结果从统计基础解释了条件深度生成模型为何能克服维度诅咒,并表明其可学习更广泛的近奇异条件分布。分析还强调,当数据紧邻流形支撑时,引入小噪声扰动至关重要。数值实验在合成与真实数据集上验证了方法的有效性,补充支持了理论发现。

原文摘要 · Abstract (English)

In this work, we explore the theoretical properties of conditional deep generative models under the statistical framework of distribution regression where the response variable lies in a high-dimensional ambient space but concentrates around a potentially lower-dimensional manifold. More specifically, we study the large-sample properties of a likelihood-based approach for estimating these models. Our results lead to the convergence rate of a sieve maximum likelihood estimator (MLE) for estimating the conditional distribution (and its devolved counterpart) of the response given predictors in the Hellinger (Wasserstein) metric. Our rates depend solely on the intrinsic dimension and smoothness of the true conditional distribution. These findings provide an explanation of why conditional deep generative models can circumvent the curse of dimensionality from the perspective of statistical foundations and demonstrate that they can learn a broader class of nearly singular conditional distributions. Our analysis also emphasizes the importance of introducing a small noise perturbation to the data when they are supported sufficiently close to a manifold. Finally, in our numerical studies, we demonstrate the effective implementation of the proposed approach using both synthetic and real-world datasets, which also provide complementary validation to our theoretical findings.

分布回归生成模型流形学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。