用引导掩码提升壁画修复精度,兼顾整体结构与细节。
CMAMRNet: A Contextual Mask-Aware Network Enhancing Mural Restoration Through Comprehensive Mask Guidance
- 引入感知掩码的上下采样模块,保持多尺度特征一致性。
- 在高/低分辨率同时提取互补特征,还原破损处纹理与轮廓。
- 适合文化遗产数字化修复,对艺术真实性要求高的场景。
壁画作为珍贵文化遗产,长期受环境因素和人为活动影响而持续退化。数字修复面临退化模式复杂、需保留艺术真实性的挑战。现有基于学习的方法在神经网络中难以维持一致的掩码引导,导致对损伤区域关注不足,修复质量下降。本文提出CMAMRNet——一种基于上下文掩码感知的壁画修复网络,通过全面的掩码引导与多尺度特征提取解决上述问题。框架包含两个核心组件:(1) 掩码感知的上下采样器(MAUDS),通过通道级特征选择与掩码引导融合,在不同分辨率间保持掩码敏感性;(2) 共同特征聚合器(CFA),在最高与最低分辨率处协同工作,提取互补特征以捕捉退化区域的精细纹理与全局结构。在基准数据集上的实验表明,CMAMRNet优于当前最优方法,有效保留了修复后的结构完整性和艺术细节。代码已开源于~\href{https://github.com/CXH-Research/CMAMRNet}{https://github.com/CXH-Research/CMAMRNet}。
原文摘要 · Abstract (English)
Murals, as invaluable cultural artifacts, face continuous deterioration from environmental factors and human activities. Digital restoration of murals faces unique challenges due to their complex degradation patterns and the critical need to preserve artistic authenticity. Existing learning-based methods struggle with maintaining consistent mask guidance throughout their networks, leading to insufficient focus on damaged regions and compromised restoration quality. We propose CMAMRNet, a Contextual Mask-Aware Mural Restoration Network that addresses these limitations through comprehensive mask guidance and multi-scale feature extraction. Our framework introduces two key components: (1) the Mask-Aware Up/Down-Sampler (MAUDS), which ensures consistent mask sensitivity across resolution scales through dedicated channel-wise feature selection and mask-guided feature fusion; and (2) the Co-Feature Aggregator (CFA), operating at both the highest and lowest resolutions to extract complementary features for capturing fine textures and global structures in degraded regions. Experimental results on benchmark datasets demonstrate that CMAMRNet outperforms state-of-the-art methods, effectively preserving both structural integrity and artistic details in restored murals. The code is available at~\href{https://github.com/CXH-Research/CMAMRNet}{https://github.com/CXH-Research/CMAMRNet}.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。