提出新方法在图像分割中精准捕捉小结构,提升边界识别效果。
SEMIR: Semantic Minor-Induced Representation Learning on Graphs for Visual Segmentation

- 用可学习的图压缩替代固定降采样,保留关键边界信息
- 在三个肿瘤数据集上显著提升小目标分割的Dice分数
- 适合高分辨率医学图像分割,尤其关注稀疏结构的任务
在大规模图像中分割小而稀疏的结构,受限于体素级网格计算和极端类别不平衡——全分辨率推理效率低,多数方法依赖固定区域划分或下采样,使计算成本随图像分辨率上升,并削弱了少数结构最敏感的边界证据。本文提出SEMIR(语义小图诱导表征学习),通过学习任务自适应、拓扑保持的隐式图表示,实现推理与原始网格解耦。SEMIR通过参数化边收缩、节点删除和边删除,将原始网格图转化为紧凑且边界对齐的图子图,同时保持从子图预测到网格标签的精确映射。子图构建被建模为少样本结构学习问题,以边界对齐为目标:通过最大化预测边界元素与目标特定语义边之间的边界Dice一致性来学习子图参数;子图标注了尺度与旋转鲁棒的几何和强度描述符,并通过带有关系边特征的图神经网络实现高效区域级推理。在BraTS 2021、KiTS23和LiTS三个肿瘤分割数据集上验证,目标具有高度结构变异性和分布不确定性,SEMIR在实际运行时间下持续提升少数结构的分割性能。更广泛地,SEMIR建立了一种适用于高分辨率结构化视觉数据的、可学习、拓扑保持且支持精确解码的潜在表示框架。
原文摘要 · Abstract (English)
Segmenting small and sparse structures in large-scale images is fundamentally constrained by voxel-level, lattice-bound computation and extreme class imbalance -- dense, full-resolution inference scales poorly and forces most pipelines to rely on fixed regionization or downsampling, coupling computational cost to image resolution and attenuating boundary evidence precisely where minority structures are most informative. We introduce SEMIR (Semantic Minor-Induced Representation Learning), a representation framework that decouples inference from the native grid by learning a task-adapted, topology-preserving latent graph representation with exact decoding. SEMIR transforms the underlying grid graph into a compact, boundary-aligned graph minor through parameterized edge contraction, node deletion, and edge deletion, while preserving an exact lifting map from minor predictions to lattice labels. Minor construction is formalized as a few-shot structure learning problem that replaces hand-tuned preprocessing with a boundary-alignment objective: minor parameters are learned by maximizing agreement between predicted boundary elements and target-specific semantic edges under a boundary Dice criterion, and the induced minor is annotated with scale- and rotation-robust geometric and intensity descriptors and supports efficient region-level inference via message passing on a graph neural network (GNN) with relational edge features. We benchmark SEMIR on three tumor segmentation datasets -- BraTS 2021, KiTS23, and LiTS -- where targets exhibit high structural variability and distributional uncertainty. SEMIR yields consistent improvements in minority-structure Dice at practical runtime. More broadly, SEMIR establishes a framework for learning task-adapted, topology-preserving latent representations with exact decoding for high-resolution structured visual data.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。