arXiv:2604.06796cs.LGcs.AI2026-04

让变分自编码器根据输入动态调整参数,提升推断精度。

Instance-Adaptive Parametrization for Amortized Variational Inference

论文配图:Instance-Adaptive Parametrization for Amortized Variational Inference
图 1 · 摘自论文原文
  • 用超网络生成随输入变化的编码器调制参数。
  • 在图像数据集上提升证据下界(ELBO),减少推断误差。
  • 参数更少却性能更好,适合资源受限场景使用。

变分自编码器(VAE)依赖摊销变分推断实现高效后验逼近,但共享参数结构导致摊销差距。本文提出实例自适应变分自编码器(IA-VAE),通过超网络生成输入相关的编码器参数调制,实现输入特定的推断模型适应,同时保持单次前向传播的效率。理论上,IA-VAE诱导的变分族包含标准摊销推断,因此最优ELBO不会更差。实验表明,在合成数据上,IA-VAE能更准确逼近真实后验,显著缩小摊销差距;在标准图像基准测试中,持续提升保留证据下界(ELBO),多轮实验均具统计显著性。结果表明,通过实例自适应调制增强推断参数灵活性,是缓解深度生成模型中摊销次优性的有效策略。

原文摘要 · Abstract (English)

Variational autoencoders (VAEs) rely on amortized variational inference to enable efficient posterior approximation, but this efficiency comes at the cost of a shared parametrization, giving rise to the amortization gap. We propose the instance-adaptive variational autoencoder (IA-VAE), an amortized inference framework in which a hypernetwork generates input-dependent modulations of a shared encoder. This enables input-specific adaptation of the inference model while preserving the efficiency of a single forward pass. From a theoretical perspective, we show that the variational family induced by IA-VAE contains that of standard amortized inference, implying that IA-VAE cannot yield a worse optimal ELBO. By leveraging instance-specific parameter modulations, the proposed approach can achieve performance comparable to standard encoders with substantially fewer parameters, indicating a more efficient use of model capacity. Experiments on synthetic data, where the true posterior is known, show that IA-VAE yields more accurate posterior approximations and reduces the amortization gap. Similarly, on standard image benchmarks, IA-VAE consistently improves held-out ELBO over baseline VAEs, with statistically significant gains across multiple runs. These results suggest that increasing the flexibility of the inference parametrization through instance-adaptive modulation is an effective strategy for mitigating amortization-induced suboptimality in deep generative models.

变分推断自编码器参数调制生成模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。