arXiv:2511.20924cs.CV2025-11被引 1

用可学习的高斯分布增强图像隐式表示,实现可编辑、物理一致的图像重建。

GaINeR: Geometry-Aware Implicit Network Representation

  • 将高斯分布与神经网络结合,通过最近邻加权生成图像像素
  • 支持超分辨率与几何一致性变换,重建质量达当前最优
  • 适合需要局部编辑和物理模拟的交互式图像处理场景

隐式神经表示(INRs)广泛用于建模连续2D图像,实现高保真重建、超分辨率和压缩。如SIREN、WIRE和FINER等架构能捕捉图像细节。但传统INRs缺乏显式几何结构,限制了局部编辑与物理模拟集成。为此,我们提出GaINeR(Geometry-Aware Implicit Neural Representation for Image Editing),一种针对2D图像的新框架,结合可训练高斯分布与基于神经网络的INR。对于给定图像坐标,模型检索K个最近高斯,聚合距离加权嵌入,并通过神经网络预测RGB值。该设计实现连续图像表示、可解释几何结构及灵活局部编辑,为物理感知与交互式图像操作奠定基础。方法支持几何一致变换、无缝超分辨率,并可将单张2D图像升维为几何感知3D表示,实现深度引导编辑。实验表明,GaINeR在重建质量上达到当前最优,同时保持灵活且物理一致的图像编辑能力。官方代码已公开于https://github.com/WJakubowska/GaINeR。

原文摘要 · Abstract (English)

Implicit Neural Representations (INRs) are widely used for modeling continuous 2D images, enabling high-fidelity reconstruction, super-resolution, and compression. Architectures such as SIREN, WIRE, and FINER demonstrate their ability to capture fine image details. However, conventional INRs lack explicit geometric structure, limiting local editing, and integration with physical simulation. To address these limitations, we propose GaINeR (Geometry-Aware Implicit Neural Representation for Image Editing), a novel framework for 2D images that combines trainable Gaussian distributions with a neural network-based INR. For a given image coordinate, the model retrieves the K nearest Gaussians, aggregates distance-weighted embeddings, and predicts the RGB value via a neural network. This design enables continuous image representation, interpretable geometric structure, and flexible local editing, providing a foundation for physically aware and interactive image manipulation. Our method supports geometry-consistent transformations, seamless super-resolution, and integration with physics-based simulations. Moreover, the Gaussian representation allows lifting a single 2D image into a geometry-aware 3D representation, enabling depth-guided editing. Experiments demonstrate that GaINeR achieves state-of-the-art reconstruction quality while maintaining flexible and physically consistent image editing. The official implementation of our method is publicly available at https://github.com/WJakubowska/GaINeR.

隐式表示图像编辑几何感知高斯建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。