arXiv:2508.01574cs.CV2025-08被引 5

用拓扑特征增强医学图像分类,提升模型对结构细节的敏感度。

TopoImages: Incorporating Local Topology Encoding into Deep Learning Models for Medical Image Classification

  • 通过持久同调提取图像局部块的拓扑特征,生成向量化表示
  • 多视角拓扑图像融合使分类准确率显著优于现有方法
  • 可无缝嵌入主流深度学习框架,适合医学图像分析场景

图像中的拓扑结构(如连通区域和环)在理解内容(如生物医学对象)中起关键作用。尽管众多基于外观信息的图像处理方法取得了显著成功,但在通用深度学习框架中往往缺乏对拓扑结构的敏感性。本文提出一种新方法 TopoImages(拓扑图像),通过编码图像局部块的局部拓扑信息,生成新的输入表示。在 TopoImages 中,利用持久同调(PH)编码图像块中的几何与拓扑特征,首先计算块的持久图(PDs),再将这些 PDs 向量化并排列为块像素的长向量,形成多通道图像形式的拓扑表示。为进一步捕获多样且重要的拓扑特征,确保更全面丰富的表征,我们使用多种滤波函数生成输入图像的多个拓扑图像,称为多视角拓扑图像。将多视角拓扑图像与原始图像融合后用于深度学习分类,取得显著性能提升。该方法高度通用,可无缝集成至常见深度学习框架。在三个公开医学图像分类数据集上的实验表明,其分类准确率明显优于当前最优方法。

原文摘要 · Abstract (English)

Topological structures in image data, such as connected components and loops, play a crucial role in understanding image content (e.g., biomedical objects). % Despite remarkable successes of numerous image processing methods that rely on appearance information, these methods often lack sensitivity to topological structures when used in general deep learning (DL) frameworks. % In this paper, we introduce a new general approach, called TopoImages (for Topology Images), which computes a new representation of input images by encoding local topology of patches. % In TopoImages, we leverage persistent homology (PH) to encode geometric and topological features inherent in image patches. % Our main objective is to capture topological information in local patches of an input image into a vectorized form. % Specifically, we first compute persistence diagrams (PDs) of the patches, % and then vectorize and arrange these PDs into long vectors for pixels of the patches. % The resulting multi-channel image-form representation is called a TopoImage. % TopoImages offers a new perspective for data analysis. % To garner diverse and significant topological features in image data and ensure a more comprehensive and enriched representation, we further generate multiple TopoImages of the input image using various filtration functions, which we call multi-view TopoImages. % The multi-view TopoImages are fused with the input image for DL-based classification, with considerable improvement. % Our TopoImages approach is highly versatile and can be seamlessly integrated into common DL frameworks. Experiments on three public medical image classification datasets demonstrate noticeably improved accuracy over state-of-the-art methods.

医学图像拓扑分析深度学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。