arXiv:2411.10298cs.CL2024-11中稿 · KDD综述被引 3

用拓扑方法分析文本结构,揭示传统模型难捕捉的语言内在规律。

Topological Data Analysis Applications in Natural Language Processing: A Survey

  • 通过拓扑数据分析文本的几何与结构特征,补充传统机器学习短板。
  • 系统梳理137篇论文,区分理论解释与技术融合两类研究路径。
  • 适合关注语言深层结构、对拓扑方法感兴趣的NLP研究者参考。

互联网数据的激增推动了大规模数据分析计算方法的应用。机器学习(ML)已成为核心范式,用于模式发现、预测和表征学习。然而真实数据常具噪声、不平衡、稀疏性、监督有限和高维等特性,促使人们采用补充性分析视角。拓扑数据分析(TDA)作为一种统计框架,聚焦数据的内在形状与结构组织,不替代机器学习,而是提供一种补充视角,以刻画常规特征或纯预测方法难以捕捉的几何与拓扑属性。这推动了将TDA融入机器学习流程的研究,尤其在数据结构关键的场景中。尽管如此,相较于计算机视觉等结构更明显的领域,TDA在自然语言处理(NLP)中仍受关注较少。本综述全面调研了该领域的137篇论文,分为理论与非理论两类:前者用拓扑解释语言现象,后者通过多种数值表示将TDA嵌入基于机器学习的流程。最后讨论了当前关键挑战与开放问题。资源与论文列表见:https://github.com/AdaUchendu/AwesomeTDA4NLP。

原文摘要 · Abstract (English)

The surge of data available on the Internet has driven the adoption of a wide range of computational methods for analyzing and extracting insights from large-scale data. Among these, Machine Learning (ML) has become a central paradigm, offering powerful tools for pattern discovery, prediction, and representation learning across many domains. At the same time, real-world data often exhibit properties such as noise, imbalance, sparsity, limited supervision, and high dimensionality, motivating the use of additional analytical perspectives that can complement standard ML pipelines. One such perspective is Topological Data Analysis (TDA), a statistical framework that focuses on the intrinsic shape and structural organization of data. Rather than replacing ML, TDA offers a complementary lens for characterizing geometric and topological properties that may be difficult to capture with conventional feature-based or purely predictive approaches. This has motivated a growing body of work that integrates TDA into ML workflows, particularly in settings where data structure plays an important role. Despite this promise, TDA has received relatively limited attention in Natural Language Processing (NLP) compared to domains with more overt structural regularities, such as computer vision. Nevertheless, a dedicated community of researchers has explored its use in NLP, leading to 137 papers that we comprehensively survey in this work. We organize these studies into theoretical and nontheoretical approaches. Theoretical approaches use topology to explain linguistic phenomena, whereas non-theoretical approaches incorporate TDA into ML-based pipelines through a variety of numerical representations. We conclude by discussing the key challenges and open questions that continue to shape this emerging area. Resources and a list of papers are available at: https://github.com/AdaUchendu/AwesomeTDA4NLP.

拓扑分析自然语言综述

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。