arXiv:2509.10011cs.LGcs.AI2025-09被引 1

IDEA通过投影损失与取消层,精准估计数据内在维度并实现高质量重建。

Intrinsic Dimension Estimating Autoencoder (IDEA) Using CancelOut Layer and a Projected Loss

  • 采用重加权双取消层构建潜空间结构
  • 在理论基准上准确估计维度,重建误差低于0.15
  • 适合处理流体模拟等高维非线性数据的降维与重构

本文提出内在维度估计自编码器(IDEA),用于识别样本位于线性或非线性流形上的各类数据集的内在维度。除估计维度外,IDEA还能将数据投影至对应潜空间后完成原始数据重建,其潜空间结构基于重加权双取消层构建。关键贡献在于引入投影重建损失项,在训练中持续评估移除一个潜维度后的重建质量。我们首先在一系列理论基准上验证IDEA的鲁棒性,测试其重建能力并与当前最优方法对比,结果显示本方法具备高准确率和强通用性。随后,我们将模型应用于由一维自由表面流数值解生成的数据,该数据通过对垂直速度剖面在水平、垂直方向及时间上进行点式离散获得。IDEA成功估计了数据集的内在维度,并直接在神经网络识别的投影空间内重建了原始解。

原文摘要 · Abstract (English)

This paper introduces the Intrinsic Dimension Estimating Autoencoder (IDEA), which identifies the underlying intrinsic dimension of a wide range of datasets whose samples lie on either linear or nonlinear manifolds. Beyond estimating the intrinsic dimension, IDEA is also able to reconstruct the original dataset after projecting it onto the corresponding latent space, which is structured using re-weighted double CancelOut layers. Our key contribution is the introduction of the projected reconstruction loss term, guiding the training of the model by continuously assessing the reconstruction quality under the removal of an additional latent dimension. We first assess the performance of IDEA on a series of theoretical benchmarks to validate its robustness. These experiments allow us to test its reconstruction ability and compare its performance with state-of-the-art intrinsic dimension estimators. The benchmarks show good accuracy and high versatility of our approach. Subsequently, we apply our model to data generated from the numerical solution of a vertically resolved one-dimensional free-surface flow, following a pointwise discretization of the vertical velocity profile in the horizontal direction, vertical direction, and time. IDEA succeeds in estimating the dataset's intrinsic dimension and then reconstructs the original solution by working directly within the projection space identified by the network.

降维自编码器流形学习流体模拟

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。