将拓扑特征融入深度学习,提升小样本图像分析效果
CuMPerLay: Learning Cubical Multiparameter Persistence Vectorizations
- 将多参数拓扑分解为可学习的单参数持久性,实现端到端训练
- 在医学影像与计算机视觉数据集上显著提升分类与分割精度
- 适合需要结构化信息的图像分析任务,尤其小样本场景
我们提出CuMPerLay,一种可微分的向量化层,首次将立方体多参数持久性(CMP)无缝集成到深度学习框架中。尽管CMP能自然捕捉图像的拓扑结构,但其多滤波结构复杂且难以向量化。为此,我们设计新算法,将多参数同调分解为可学习的单参数持久性,并联合优化双滤波函数。得益于可微性,该方法生成的鲁棒拓扑特征可直接嵌入Swin Transformer等先进架构。理论证明其在广义Wasserstein度量下具有稳定性。在基准医学影像与计算机视觉数据集上的实验表明,该方法在有限数据条件下显著提升分类与分割性能。整体而言,CuMPerLay为深度网络注入全局结构信息提供了新路径。
原文摘要 · Abstract (English)
We present CuMPerLay, a novel differentiable vectorization layer that enables the integration of Cubical Multiparameter Persistence (CMP) into deep learning pipelines. While CMP presents a natural and powerful way to topologically work with images, its use is hindered by the complexity of multifiltration structures as well as the vectorization of CMP. In face of these challenges, we introduce a new algorithm for vectorizing MP homologies of cubical complexes. Our CuMPerLay decomposes the CMP into a combination of individual, learnable single-parameter persistence, where the bifiltration functions are jointly learned. Thanks to the differentiability, its robust topological feature vectors can be seamlessly used within state-of-the-art architectures such as Swin Transformers. We establish theoretical guarantees for the stability of our vectorization under generalized Wasserstein metrics. Our experiments on benchmark medical imaging and computer vision datasets show the benefit CuMPerLay on classification and segmentation performance, particularly in limited-data scenarios. Overall, CuMPerLay offers a promising direction for integrating global structural information into deep networks for structured image analysis.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。