arXiv:2510.00043cs.LGcs.CL2025-10

用p进制度量空间改进回归,更适配层级数据结构。

Linear Regression in p-adic metric spaces

  • 在p进制度量下,拟合n维平面必须经过至少n+1个数据点
  • 多项式回归在p进制下至少通过n+1个观测点,体现离散特性
  • 适合处理语言学中的分类体系与形态结构建模

许多现实世界的机器学习问题涉及固有的层级数据,但传统方法依赖欧几里得度量,无法捕捉层级关系的离散分支特性。本文建立了机器学习在p进制度量空间中的理论基础,该度量天然契合层级结构。主要结果表明:最小化数据点到n维平面的p进制距离和时,该平面必经过至少n+1个数据点——这与欧几里得回归形成鲜明对比,凸显了p进制度量对离散层级数据的更好匹配性。作为推论,最小化残差p进制和的n次多项式将至少经过n+1个点;若用n次多项式逼近高次多项式在有限点上的值,则其差值多项式具有互异的有理根。我们通过自然语言处理中的两个应用展示了该理论的实际意义:分析层级分类体系和建模语法形态。这些结果表明,p进制度量可能在机器学习中正确处理层级数据结构方面具有根本作用。在层级数据中,插值往往不如直接选取实际观测点作为代表合理。

原文摘要 · Abstract (English)

Many real-world machine learning problems involve inherently hierarchical data, yet traditional approaches rely on Euclidean metrics that fail to capture the discrete, branching nature of hierarchical relationships. We present a theoretical foundation for machine learning in p-adic metric spaces, which naturally respect hierarchical structure. Our main result proves that an n-dimensional plane minimizing the p-adic sum of distances to points in a dataset must pass through at least n + 1 of those points -- a striking contrast to Euclidean regression that highlights how p-adic metrics better align with the discrete nature of hierarchical data. As a corollary, a polynomial of degree n constructed to minimise the p-adic sum of residuals will pass through at least n + 1 points. As a further corollary, a polynomial of degree n approximating a higher degree polynomial at a finite number of points will yield a difference polynomial that has distinct rational roots. We demonstrate the practical significance of this result through two applications in natural language processing: analyzing hierarchical taxonomies and modeling grammatical morphology. These results suggest that p-adic metrics may be fundamental to properly handling hierarchical data structures in machine learning. In hierarchical data, interpolation between points often makes less sense than selecting actual observed points as representatives.

p进制层级数据回归分析自然语言处理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。