arXiv:2509.01964cs.CVcs.AI2025-09被引 3

用2D高斯点云实现图像修复,兼顾局部细节与全局语义一致性。

2D Gaussian Splatting with Semantic Alignment for Image Inpainting

  • 将不完整图像编码为可微分的2D高斯点云,通过连续渲染修复缺失区域。
  • 在标准数据集上达到领先水平的定量指标和视觉质量。
  • 结合DINO模型特征,提升大范围缺失时的语义一致性,适合复杂修复场景。

高斯点阵(Gaussian Splatting, GS)是一种将离散点转化为连续空间表示的新技术,在3D场景建模和2D图像超分辨率中表现优异。本文首次探索其在图像修复中的潜力,该任务需同时保证局部像素连贯性与全局语义一致性。我们提出首个基于2D GS的图像修复框架,将不完整图像编码为2D高斯点云系数的连续场,并通过可微分光栅化过程重建图像。GS的连续渲染机制天然促进修复结果的像素级连贯性。为提升效率与可扩展性,引入分块光栅化策略,降低内存开销并加速推理。为增强全局语义一致性,融入预训练DINO模型的特征。实验表明,DINO的全局特征对小范围缺失具有鲁棒性,且可有效适配大掩码场景,确保修复内容与上下文一致。在多个标准基准测试中,本方法在定量指标与感知质量上均表现优异,开辟了将高斯点阵应用于2D图像处理的新路径。

原文摘要 · Abstract (English)

Gaussian Splatting (GS), a recent technique for converting discrete points into continuous spatial representations, has shown promising results in 3D scene modeling and 2D image super-resolution. In this paper, we explore its untapped potential for image inpainting, which demands both locally coherent pixel synthesis and globally consistent semantic restoration. We propose the first image inpainting framework based on 2D Gaussian Splatting, which encodes incomplete images into a continuous field of 2D Gaussian splat coefficients and reconstructs the final image via a differentiable rasterization process. The continuous rendering paradigm of GS inherently promotes pixel-level coherence in the inpainted results. To improve efficiency and scalability, we introduce a patch-wise rasterization strategy that reduces memory overhead and accelerates inference. For global semantic consistency, we incorporate features from a pretrained DINO model. We observe that DINO's global features are naturally robust to small missing regions and can be effectively adapted to guide semantic alignment in large-mask scenarios, ensuring that the inpainted content remains contextually consistent with the surrounding scene. Extensive experiments on standard benchmarks demonstrate that our method achieves competitive performance in both quantitative metrics and perceptual quality, establishing a new direction for applying Gaussian Splatting to 2D image processing.

图像修复高斯点阵语义对齐

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。