arXiv:2502.08098cs.LGcs.NE2025-02被引 3

神经网络可无监督区分不同特征空间,突破传统坐标独立限制。

Unsupervised categorization of similarity measures

  • 通过约束空间独立而非坐标轴独立,实现特征空间自动分类
  • 高维空间独立性不依赖坐标轴正交,解决传统方法局限
  • 适用于视觉、感知等需分离多维度特征的场景

通常,物体可通过颜色、形状等特征加以区分。一般假设这些特征的相似性判断可在不同的度量空间中独立处理。然而,与物体特征对应的度量空间的无监督分类机制尚不清楚。本文表明,人工神经网络系统可通过表征学习自主分类度量空间,满足神经网络间的代数独立性,并将感官信息投影到多个高维度量空间中,独立评估各特征的差异与相似性。传统方法常约束潜在空间的坐标轴相互独立或正交,但独立坐标轴不适用于度量空间的分类。因为任意一组独立坐标轴均可构成相互独立的空间,因此无法自然区分不同特征空间(如颜色空间与形状空间)。故而,强制坐标轴独立会阻碍高维度量空间的分类。为此,我们提出仅约束空间相互独立,而非坐标轴独立的方法。该理论为无监督分类独立度量空间提供了通用条件,推动了神经网络功能分化的数学理论发展。

原文摘要 · Abstract (English)

In general, objects can be distinguished on the basis of their features, such as color or shape. In particular, it is assumed that similarity judgments about such features can be processed independently in different metric spaces. However, the unsupervised categorization mechanism of metric spaces corresponding to object features remains unknown. Here, we show that the artificial neural network system can autonomously categorize metric spaces through representation learning to satisfy the algebraic independence between neural networks, and project sensory information onto multiple high-dimensional metric spaces to independently evaluate the differences and similarities between features. Conventional methods often constrain the axes of the latent space to be mutually independent or orthogonal. However, the independent axes are not suitable for categorizing metric spaces. High-dimensional metric spaces that are independent of each other are not uniquely determined by the mutually independent axes, because any combination of independent axes can form mutually independent spaces. In other words, the mutually independent axes cannot be used to naturally categorize different feature spaces, such as color space and shape space. Therefore, constraining the axes to be mutually independent makes it difficult to categorize high-dimensional metric spaces. To overcome this problem, we developed a method to constrain only the spaces to be mutually independent and not the composed axes to be independent. Our theory provides general conditions for the unsupervised categorization of independent metric spaces, thus advancing the mathematical theory of functional differentiation of neural networks.

神经网络无监督学习度量空间特征分离

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。