arXiv:2507.07291cs.LG2025-07被引 1

用变分自编码器和黎曼几何估计数据集内在维度,提升医学图像重建效果。

Estimating Dataset Dimension via Singular Metrics under the Manifold Hypothesis: Application to Inverse Problems

  • 通过解码器拉回度量的数值秩估算数据流形的内在维度
  • 基于混合可逆VAE构建局部坐标图谱,实现流形高效参数化
  • 内在维度可作模型容量监测指标,适用于生物医学成像等反问题

高维数据常呈现低维几何结构,符合流形假设——数据位于高维空间中的光滑流形上。尽管这一观点推动了机器学习与反问题的进展,但充分应用仍需解决三个核心任务:估计流形的内在维度(ID)、构造合适的局部坐标、学习环境空间与流形之间的映射关系。本文提出一种融合变分自编码器(VAE)与黎曼几何工具的框架,聚焦于通过分析VAE解码器拉回度量的数值秩来估计数据集的内在维度。该估计结果指导使用混合可逆VAE构建局部坐标图谱,实现流形的精确参数化并支持高效推理。实验表明,该方法能有效提升病态反问题的求解性能,尤其在生物医学成像中强制重建结果落在学习到的流形上。最后,研究了网络剪枝对流形几何与重构质量的影响,发现内在维度可作为模型容量的有效代理指标。

原文摘要 · Abstract (English)

High-dimensional datasets often exhibit low-dimensional geometric structures, as suggested by the manifold hypothesis, which implies that data lie on a smooth manifold embedded in a higher-dimensional ambient space. While this insight underpins many advances in machine learning and inverse problems, fully leveraging it requires to deal with three key tasks: estimating the intrinsic dimension (ID) of the manifold, constructing appropriate local coordinates, and learning mappings between ambient and manifold spaces. In this work, we propose a framework that addresses all these challenges using a Mixture of Variational Autoencoders (VAEs) and tools from Riemannian geometry. We specifically focus on estimating the ID of datasets by analyzing the numerical rank of the VAE decoder pullback metric. The estimated ID guides the construction of an atlas of local charts using a mixture of invertible VAEs, enabling accurate manifold parameterization and efficient inference. We how this approach enhances solutions to ill-posed inverse problems, particularly in biomedical imaging, by enforcing that reconstructions lie on the learned manifold. Lastly, we explore the impact of network pruning on manifold geometry and reconstruction quality, showing that the intrinsic dimension serves as an effective proxy for monitoring model capacity.

流形学习变分自编码器反问题医学图像

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。