用拓扑数学框架统一多种深度学习模型,提升结构化数据建模能力。
Copresheaf Topological Neural Networks: A Generalized Deep Learning Framework
- 基于代数拓扑的余层理论构建通用神经网络框架
- 在点云、图、网格等数据上优于传统基线模型
- 适合需要层次敏感或局部特征的任务研究者
我们提出余层拓扑神经网络(CTNNs),一种强大的统一框架,可处理图像、点云、图、网格及拓扑流形等结构化数据。尽管深度学习已广泛应用于数字助手到自动驾驶系统,但针对特定任务和数据类型的原理性架构设计仍是该领域长期存在的挑战。CTNNs通过余层语言形式化模型设计,这一代数拓扑概念可概括当前大多数实用深度学习模型。这种抽象但具构造性的表述构建了丰富的设计空间,从而可推导出理论严谨且实践有效的解决方案,应对表示学习中的长程依赖、过平滑、异质性及非欧几里得域等核心问题。我们在结构化数据基准上的实验表明,CTNNs在需要层级或局部敏感性的任务中持续优于常规基线模型。这些结果确立了CTNNs作为下一代深度学习架构的原理性多尺度基础。
原文摘要 · Abstract (English)
We introduce copresheaf topological neural networks (CTNNs), a powerful unifying framework that encapsulates a wide spectrum of deep learning architectures, designed to operate on structured data, including images, point clouds, graphs, meshes, and topological manifolds. While deep learning has profoundly impacted domains ranging from digital assistants to autonomous systems, the principled design of neural architectures tailored to specific tasks and data types remains one of the field's most persistent open challenges. CTNNs address this gap by formulating model design in the language of copresheaves, a concept from algebraic topology that generalizes most practical deep learning models in use today. This abstract yet constructive formulation yields a rich design space from which theoretically sound and practically effective solutions can be derived to tackle core challenges in representation learning, such as long-range dependencies, oversmoothing, heterophily, and non-Euclidean domains. Our empirical results on structured data benchmarks demonstrate that CTNNs consistently outperform conventional baselines, particularly in tasks requiring hierarchical or localized sensitivity. These results establish CTNNs as a principled multi-scale foundation for the next generation of deep learning architectures.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。