arXiv:2607.29595cs.CV2026-07

提出分离上下文与细节的模型,高效修复超高清图像。

CoDe-SSM: Context-Detail Decoupled State Space Model for Efficient UHD Image Restoration

论文配图:CoDe-SSM: Context-Detail Decoupled State Space Model for Efficient UHD Image Restoration
图 1 · 摘自论文原文
  • 分两条路径处理:全局上下文聚合与局部细节恢复
  • 在5个数据集上均提升恢复质量,计算效率高
  • 适合需要精细修复的超清图像任务

超高清(UHD)图像修复需平衡空间重复退化特征的聚合与局部结构的保留。紧凑聚合可减少冗余计算,但可能弱化边缘、纹理等细粒度结构。现有方法通过下采样、窗口划分或聚类令牌压缩来降低计算成本,但未能显式保留共享聚合难以表征的信息。本文提出上下文-细节解耦的状态空间模型(CoDe-SSM),分别处理聚合上下文与聚类残差。上下文建模路径采用全局聚类扫描模块(GCSM),将特征聚合为K个输入依赖的聚类中心,并对固定顺序序列进行选择性SSM推理,实现跨区域上下文共享且计算成本与空间分辨率解耦。细节恢复路径采用局部高频模块(LHFM),利用输入导出的高频掩码和稀疏卷积专家混合处理聚类残差。在五个UHD基准数据集及五类退化类型上的实验表明,该显式解耦策略显著提升修复质量,同时保持良好效率。

原文摘要 · Abstract (English)

Ultra-high-definition (UHD) image restoration must balance the aggregation of spatially recurring degradation cues with the preservation of localized image structures. Compact aggregation can reduce redundant processing but may attenuate edges, textures, and other fine structures. Existing approaches manage UHD restoration cost through downsampling, window partitioning, or cluster-based token reduction; yet many of them do not explicitly retain information that is poorly represented by shared aggregation. In this study, we propose a Context-Detail Decoupled State Space Model (CoDe-SSM) for UHD restoration, which processes aggregated context and clustering residuals in separate pathways. The context modeling pathway, implemented by the Global Cluster Scan Module (GCSM), aggregates features into $K$ input-dependent cluster centers and applies selective SSM reasoning over the resulting fixed-order sequence, enabling cross-region context sharing while decoupling computational cost from spatial resolution. The detail recovery pathway, implemented by the Local High-Frequency Module (LHFM), processes the clustering residual with an input-derived high-frequency mask and a sparse mixture of convolutional experts. Extensive experiments on five UHD benchmarks and five degradation types demonstrate that our explicit context-detail decoupling strategy yields substantial gains in restoration quality while maintaining desirable efficiency.

图像修复状态空间模型超高清细节恢复

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。