arXiv:2608.12084cs.LG2026-08

提出新型生成模型NAE,解决现有方法训练不均衡问题。

NAE: Normalizing AutoEncoder

  • 设计条件损失使编码器与解码器梯度对齐重建损失
  • 在分子、表格数据和图像任务上达到顶尖性能
  • 适合需要高质量生成的科研与工业应用

我们研究具有近似逆的归一化流,涵盖全维(d=D)和瓶颈(d<D)设置,将此类模型统称为流自编码器。通过对训练动态的理论分析,证明现有方法使用的损失函数次优;具体而言,编码器与解码器代理必须与重建损失协同优化。基于此洞察,我们提出归一化自编码器(NAE),采用一种新型条件损失,使代理损失梯度与重建损失梯度对齐,直接优于当前标准。在分子生成、表格数据和图像基准上的大量实验表明,NAE实现最先进的性能。本工作强调了流自编码器中损失对齐的重要性,并确立NAE为强大的生成框架。

原文摘要 · Abstract (English)

We consider the setting of Normalizing flows with approximate inverses, an established paradigm spanning both full-dimensional ($d=D$) and bottleneck ($d<D$) settings, and group these models under the term flow autoencoders. We present a theoretical investigation into their training dynamics and prove that the proposed loss used by existing approaches is suboptimal; specifically, both encoder and decoder surrogates must be optimized in alignment with reconstruction loss. Guided by these insights, we propose Normalizing Autoencoder (NAE), which employs a novel conditional loss that aligns the surrogate loss gradient with that of reconstruction loss, directly improving upon the current standard. Extensive experiments across molecule generation, tabular data, and image benchmarks demonstrate that NAE achieves state of the art performance. Our work highlights the importance of loss alignment in flow autoencoders and establishes NAE as a powerful generative framework.

生成模型自编码器归一化流机器学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。