提出统一框架提升可逆网络的生成与反演精度
VINA: Variational Invertible Neural Architectures
- 基于变分无监督损失构建统一架构
- 理论证明在更弱假设下仍能保证精度
- 适用于海洋声学等真实反演问题
归一化流(NFs)因其双射性与可计算雅可比行列式,特别适合生成建模。可逆神经网络(INNs)在此基础上拓展用于监督反问题,可直接建模前向与反向映射。本文从理论与实践角度重新审视这些架构,填补文献空白:现有工作缺乏在现实假设下的近似质量理论保证,无论是针对INNs的后验推断还是NFs的生成建模。我们提出一个基于变分无监督损失的统一框架,受生成对抗网络(GANs)及正则-召回散度训练归一化流的启发。在此框架下,我们推导出理论性能保证,量化了在较弱且更贴近实际的假设下INNs的后验精度与NFs的分布精度。基于这些理论结果,我们开展广泛案例研究,提炼通用设计原则与实用指南。最后,我们在一个真实的海洋声学反演问题上验证了该方法的有效性。
原文摘要 · Abstract (English)
The distinctive architectural features of normalizing flows (NFs), notably bijectivity and tractable Jacobians, make them well-suited for generative modeling. Invertible neural networks (INNs) build on these principles to address supervised inverse problems, enabling direct modeling of both forward and inverse mappings. In this paper, we revisit these architectures from both theoretical and practical perspectives and address a key gap in the literature: the lack of theoretical guarantees on approximation quality under realistic assumptions, whether for posterior inference in INNs or for generative modeling with NFs. We introduce a unified framework for INNs and NFs based on variational unsupervised loss functions, inspired by analogous formulations in related areas such as generative adversarial networks (GANs) and the Precision-Recall divergence for training normalizing flows. Within this framework, we derive theoretical performance guarantees, quantifying posterior accuracy for INNs and distributional accuracy for NFs, under assumptions that are weaker and more practically realistic than those used in prior work. Building on these theoretical results, we conduct extensive case studies to distill general design principles and practical guidelines. We conclude by demonstrating the effectiveness of our approach on a realistic ocean-acoustic inversion problem.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。