arXiv:2605.15306cs.LGstat.ML2026-05

研究数据增强如何改变神经网络的内部表示形状。

How Data Augmentation Shapes Neural Representations

论文配图:How Data Augmentation Shapes Neural Representations
图 1 · 摘自论文原文
  • 用几何分析方法将隐藏特征映射到不变距离空间。
  • 增强强度越大,特征轨迹越稳定,不同增强方式影响方向不同。
  • 几何特性可预测模型集成效果,适合研究模型泛化机制的人。

数据增强被广泛认为能提升深度网络的泛化能力,但其对学习表示几何结构的影响仍不明确。本文通过形状分析工具,将神经网络隐藏表示嵌入一个对缩放、平移、旋转和反射不变的距离空间。结果表明,增强强度增加会使该空间中的特征轨迹趋于稳定,不同增强策略会引导表示朝不同方向演化。我们还分析了特征形状在增强轨迹上的畸变情况,发现神经几何学的洞察可预测模型集成时哪些表示带来最大性能提升。研究揭示了不同架构与随机种子间共享的几何模式,表明分析形状空间轨迹是理解与比较数据增强方法的有力工具。

原文摘要 · Abstract (English)

Data augmentation is widely recognized for improving generalization in deep networks, yet its impact on the geometry of learned representations remains poorly understood. In this work, we characterize how different data augmentation strategies reshape internal representations in neural networks. Using tools from shape analysis, we embed network hidden representations into a metric space where distance is invariant to scaling, translation, rotation and reflection. We show that increasing augmentation strength leads to well-behaved trajectories in this space, and that different augmentation types steer representations in distinct directions. Moreover, we investigate how neural representation shapes are distorted along data augmentation trajectories, and show that insights from neural geometry can predict which representations provide the most improvement when ensembling models. Our results reveal shared geometric patterns across architectures and seeds, and suggest that analyzing shape-space trajectories offers a principled tool for understanding and comparing data augmentation methods.

表示学习数据增强几何分析

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。