用统一框架修复破损壁画,兼顾结构重建与真实区域保护。
High-Fidelity Mural Restoration via a Unified Hybrid Mask-Aware Transformer

- 融合动态滤波与变压器瓶颈,实现局部纹理与全局结构协同恢复。
- 在严重损坏区域下仍保持高感知真实感,优于主流基线方法。
- 适合文化遗产修复、艺术复原等需要高保真图像生成的场景。
古代壁画是珍贵的文化遗产,但因环境暴露、材料老化和人为活动而严重退化。修复工作面临双重挑战:既要补全大面积缺失结构,又要保留未受损的真实区域。本文提出混合掩码感知变压器(HMAT),一种统一的高保真壁画修复框架,结合掩码感知动态滤波(MADF)实现鲁棒的局部纹理建模,以及变压器瓶颈进行长距离结构推理,可在不规则损伤条件下恢复连续线条与连贯结构。为应对多样化的退化形态,引入掩码条件风格融合模块,根据缺失区域的形状和范围自适应生成过程。提出以保真度为导向的训练目标,包含孔洞归一化重建、判别器特征匹配和大感受野感知监督,提升受损区域保真度、纹理一致性与边界质量。此外,分析了带硬门控跳跃连接的教师强制解码器作为特征空间边界条件策略的有效性。实验表明,HMAT在感知真实性和严重遮蔽设置下均优于代表性卷积、基于变换器及边缘引导修复基线;消融研究确认所提目标、MADF掩码感知编码与掩码条件合成是修复质量提升的关键。结果证明HMAT为文化遗产壁画修复提供了有效且具有竞争力的解决方案。
原文摘要 · Abstract (English)
Ancient murals are valuable cultural artifacts, but many have suffered severe degradation due to environmental exposure, material aging, and human activity. Restoring these artworks is challenging because it requires both reconstructing large missing structures and preserving authentic, undamaged regions. We present the Hybrid Mask-Aware Transformer (HMAT), a unified framework for high-fidelity mural restoration that addresses both structural completion and authentic-region preservation. HMAT integrates Mask-Aware Dynamic Filtering for robust local texture modeling with a Transformer bottleneck for long-range structural inference, enabling recovery of continuous line patterns and coherent mural structures under irregular damage. To handle diverse degradation morphologies, we introduce a mask-conditional style fusion module that adapts the generative process according to the shape and extent of missing regions. We also propose a fidelity-oriented training objective that combines hole-normalized reconstruction, discriminator feature matching, and high-receptive-field perceptual supervision to improve damaged-region fidelity, texture consistency, and boundary quality. In addition, we analyze a Teacher-Forcing Decoder with hard-gated skip connections as a feature-space boundary-conditioning strategy. Experiments show that HMAT matches or outperforms representative convolutional, transformer-based, and edge-guided inpainting baselines, with especially strong gains in perceptual realism and severe-mask settings. Ablation studies further identify the proposed objective, MADF-based mask-aware encoding, and mask-conditioned synthesis as the main contributors to restoration quality. These results demonstrate that HMAT provides an effective and competitive solution for cultural heritage mural restoration.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。