arXiv:2506.10089cs.LG2025-06

优化分层变分自编码器的隐空间分配,提升异常检测性能

Optimizing Latent Dimension Allocation in Hierarchical VAEs: Balancing Attenuation and Information Retention for OOD Detection

  • 基于信息论构建隐层维度分配的理论框架
  • 证明存在最优分配比例,提升跨数据集检测效果
  • 适合需要可靠异常检测的高风险场景应用

分布外(OOD)检测是机器学习中的关键任务,尤其在安全敏感应用中需可靠识别意外输入。尽管分层变分自编码器(HVAEs)相比传统VAE具备更强表征能力,但其性能高度依赖于各层隐维度的分配方式。现有方法常任意分配隐空间容量,导致表征无效或后验崩溃。本文提出一个基于信息论的理论框架,形式化了信息损失与表征衰减之间的权衡,证明在固定隐空间预算下存在最优分配比例 $r^{ au}$。实验表明,调节该比例可稳定提升多种数据集和架构上的OOD检测性能。所提方法优于基线HVAE配置,为深度生成模型的隐结构设计提供可遵循的指导。

原文摘要 · Abstract (English)

Out-of-distribution (OOD) detection is a critical task in machine learning, particularly for safety-critical applications where unexpected inputs must be reliably flagged. While hierarchical variational autoencoders (HVAEs) offer improved representational capacity over traditional VAEs, their performance is highly sensitive to how latent dimensions are distributed across layers. Existing approaches often allocate latent capacity arbitrarily, leading to ineffective representations or posterior collapse. In this work, we introduce a theoretically grounded framework for optimizing latent dimension allocation in HVAEs, drawing on principles from information theory to formalize the trade-off between information loss and representational attenuation. We prove the existence of an optimal allocation ratio $r^{\ast}$ under a fixed latent budget, and empirically show that tuning this ratio consistently improves OOD detection performance across datasets and architectures. Our approach outperforms baseline HVAE configurations and provides practical guidance for principled latent structure design, leading to more robust OOD detection with deep generative models.

OOD检测变分自编码器信息论隐空间优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。