提出BPT模型,高效实现超高清图像分割,兼顾全局与细节。
Ultra-High Resolution Segmentation via Boundary-Enhanced Patch-Merging Transformer
- 用动态令牌分配机制融合全局与局部特征
- 边界增强模块显著提升细粒度分割效果
- 无需额外计算开销,适合高分辨率场景
超高清(UHR)图像分割在诸多应用中至关重要,但因其高空间分辨率和丰富细粒度信息,带来巨大挑战。现有方法采用双分支结构,全局分支学习长程上下文,局部分支捕捉细节,但难以协调两者关系,且增加显著计算开销。受人类视觉系统快速聚焦于重要细节区域的启发,我们提出边界增强型补丁合并变压器(Boundary-enhanced Patch-merging Transformer, BPT)。BPT包含两个核心组件:(1) 补丁合并变压器(PMT),动态将令牌分配至信息丰富的区域以获取全局与局部表征;(2) 边界增强模块(BEM),利用边界信息强化细粒度细节。在多个超高清图像分割基准测试中,BPT在不引入额外计算开销的前提下,超越了以往最先进方法。
原文摘要 · Abstract (English)
Segmentation of ultra-high resolution (UHR) images is a critical task with numerous applications, yet it poses significant challenges due to high spatial resolution and rich fine details. Recent approaches adopt a dual-branch architecture, where a global branch learns long-range contextual information and a local branch captures fine details. However, they struggle to handle the conflict between global and local information while adding significant extra computational cost. Inspired by the human visual system's ability to rapidly orient attention to important areas with fine details and filter out irrelevant information, we propose a novel UHR segmentation method called Boundary-enhanced Patch-merging Transformer (BPT). BPT consists of two key components: (1) Patch-Merging Transformer (PMT) for dynamically allocating tokens to informative regions to acquire global and local representations, and (2) Boundary-Enhanced Module (BEM) that leverages boundary information to enrich fine details. Extensive experiments on multiple UHR image segmentation benchmarks demonstrate that our BPT outperforms previous state-of-the-art methods without introducing extra computational overhead. Codes will be released to facilitate research.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。