提出方形超像素生成方法,提升视觉模型计算效率与可学习性。
Square Superpixel Generation and Representation Learning via Granular Ball Computing
- 用多尺度方块近似超像素,避免不规则形状带来的计算难题。
- 基于像素强度相似性计算纯度得分,筛选高质量方块区域。
- 可直接接入GNN或ViT,适合需要结构化表示的深度学习任务。
超像素提供紧凑的区域表示,保留物体边界和局部结构,广泛应用于各类视觉任务以降低计算成本。然而,现有大多数超像素算法生成不规则形状区域,难以与卷积等常规算子对齐,通常只能作为离线预处理步骤,限制了并行实现和深度学习流水线中的端到端优化。受粒球计算自适应表征与覆盖特性的启发,本文提出一种方形超像素生成方法。具体地,通过多尺度方块近似超像素,避免不规则形状带来的计算与实现困难,支持高效并行处理和可学习特征提取。每个方块基于像素强度相似性计算纯度得分,进而选取高质量块。所得方形超像素可直接作为图神经网络(GNN)的节点或视觉变换器(ViT)的令牌,促进多尺度信息聚合与结构化视觉表示。下游任务实验结果表明性能持续提升,验证了该方法的有效性。
原文摘要 · Abstract (English)
Superpixels provide a compact region-based representation that preserves object boundaries and local structures, and have therefore been widely used in a variety of vision tasks to reduce computational cost. However, most existing superpixel algorithms produce irregularly shaped regions, which are not well aligned with regular operators such as convolutions. Consequently, superpixels are often treated as an offline preprocessing step, limiting parallel implementation and hindering end-to-end optimization within deep learning pipelines. Motivated by the adaptive representation and coverage property of granular-ball computing, we develop a square superpixel generation approach. Specifically, we approximate superpixels using multi-scale square blocks to avoid the computational and implementation difficulties induced by irregular shapes, enabling efficient parallel processing and learnable feature extraction. For each block, a purity score is computed based on pixel-intensity similarity, and high-quality blocks are selected accordingly. The resulting square superpixels can be readily integrated as graph nodes in graph neural networks (GNNs) or as tokens in Vision Transformers (ViTs), facilitating multi-scale information aggregation and structured visual representation. Experimental results on downstream tasks demonstrate consistent performance improvements, validating the effectiveness of the proposed method.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。