arXiv:2607.16725stat.MLcs.LG2026-07

用低维隐空间提升少标签条件生成,更高效利用无标签数据。

Semi-Supervised Conditional Generative Learning through Stochastic Interpolation and Sufficient Representations

  • 分两阶段生成:先采样条件隐变量,再高维重建。
  • 理论证明收敛更快,样本效率显著优于直接建模。
  • 适合标签稀缺但数据量大的生成任务,如图像合成。

在标签数据稀少而无标签数据丰富的半监督条件下,条件生成建模仍具挑战。本文提出一种结合条件随机插值与低维隐表示的半监督框架——RepG。该方法将生成过程分为两个阶段:标签依赖的隐变量采样和高维重构。通过将监督学习限制在低维隐空间,仅需少量标签即可有效利用大量无标签数据进行重建。理论上,我们建立了误差分解,表明RepG的Kullback-Leibler散度由阶段估计误差与由条件互信息量化结构偏差构成。对于深度神经网络估计器,我们推导出非渐近收敛速率,证明RepG显著提升样本复杂度。通过将监督估计负担置于隐表示的低内在维度,实现了严格更快的收敛速率。结合极小极大下界,理论结果表明该方法能有效缓解直接在高维空间建模固有的维度灾难问题。

原文摘要 · Abstract (English)

Conditional generative modeling remains a challenging problem in semi-supervised settings where labeled data is scarce but unlabeled samples are abundant. To effectively leverage structural information embedded within the unlabeled dataset and compensate for sparse conditioning signals, we propose a semi-supervised framework combining conditional stochastic interpolation with low-dimensional latent representations. RepG decomposes generation into two stages: label-dependent latent sampling and high-dimensional reconstruction. This isolates the supervised learning of conditional dependencies to a low-dimensional space, requiring few labels while utilizing the abundant unlabeled data purely for reconstruction. Theoretically, we establish an error decomposition showing that the Kullback-Leibler divergence of RepG comprises stage-wise estimation errors and a structural bias quantified by conditional mutual information. For deep neural network estimators, we derive non-asymptotic convergence rates proving that RepG significantly improves sample complexity. By confining the supervised estimation burden to the low intrinsic dimension of the latent representation, RepG achieves a strictly faster convergence rate. Complemented by a minimax lower bound, our theoretical results demonstrate that this method effectively mitigates the curse of dimensionality inherent in direct ambient-space generative modeling.

条件生成半监督隐空间生成模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。