提出分层变压器模型,统一处理部件与物体分割。
From Pixels to Objects: A Hierarchical Approach for Part and Object Segmentation Using Local and Global Aggregation
- 分层设计:从像素到超像素再到整体对象逐步聚合
- 局部聚类生成部件,全局聚类整合为完整物体
- 在两个数据集上分别提升2.8%和2.0%的分割精度
本文提出一种基于分层Transformer的图像分割模型,有效衔接部件分割的细粒度与物体分割的全面性。该方法采用多级表征策略,系统地从像素推进至超像素,最终形成连贯的群体结构。核心是两种聚合机制:局部聚合利用图像冗余性生成与物体部件对齐的超像素,受物体级监督引导;全局聚合则将超像素关联成对应完整物体的大组,受益于部件级监督。双重聚合框架在不同监督条件下均保持良好适应性与计算效率。在PartImageNet数据集上,部件与物体分割的mIoU分别较之前最优模型提升2.8%和0.8%;在Pascal Part数据集上,相应提升分别为1.5%和2.0%。
原文摘要 · Abstract (English)
In this paper, we introduce a hierarchical transformer-based model designed for sophisticated image segmentation tasks, effectively bridging the granularity of part segmentation with the comprehensive scope of object segmentation. At the heart of our approach is a multi-level representation strategy, which systematically advances from individual pixels to superpixels, and ultimately to cohesive group formations. This architecture is underpinned by two pivotal aggregation strategies: local aggregation and global aggregation. Local aggregation is employed to form superpixels, leveraging the inherent redundancy of the image data to produce segments closely aligned with specific parts of the object, guided by object-level supervision. In contrast, global aggregation interlinks these superpixels, organizing them into larger groups that correlate with entire objects and benefit from part-level supervision. This dual aggregation framework ensures a versatile adaptation to varying supervision inputs while maintaining computational efficiency. Our methodology notably improves the balance between adaptability across different supervision modalities and computational manageability, culminating in significant enhancement in segmentation performance. When tested on the PartImageNet dataset, our model achieves a substantial increase, outperforming the previous state-of-the-art by 2.8% and 0.8% in mIoU scores for part and object segmentation, respectively. Similarly, on the Pascal Part dataset, it records performance enhancements of 1.5% and 2.0% for part and object segmentation, respectively.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。