用新型几何粒子提升任意尺度图像超分,速度与质量双优。
Resonant Brane Splatting for Arbitrary-Scale Super-Resolution

- 用可变颜色的'膜片'替代传统高斯点,单个粒子即可表达复杂纹理。
- 在多个基准上优于现有方法,重建质量更高且推理速度更快。
- 适合需要高速高质图像生成的研究者和工业应用
任意尺度超分辨率(ASR)可在连续缩放因子下重建图像。近期方法通过将计算密集的隐式神经解码器替换为显式的二维高斯点阵(GS)来加速推理。然而,由于标准高斯函数是平滑的低通基元,建模边缘和细粒度纹理需大量重叠且对齐良好的点阵,导致光栅化阶段严重瓶颈。为此,我们提出共振膜片点阵(RBS),一种前馈式ASR框架。RBS将平面高斯替换为‘膜片’:具有空间变化颜色的表达力强的基元,可在单一足迹内原生建模局部对比度与复杂纹理。通过在标准高斯包络中引入内部高斯-埃尔米特模式,并为每种模式分配独立颜色系数实现。零阶模式恢复标准GS,高阶模式捕捉高频信息。膜片参数直接由低分辨率特征预测。由于膜片在数学上比简单高斯更丰富,重建目标像素所需重叠原素显著减少。为此,我们设计了一种高效的全可微光栅化器,基于经典量子转折点提出精确裁剪策略,安全跳过无关区域,大幅降低渲染开销。在标准ASR基准上的实验表明,RBS在重建质量上超越隐式与GS基线,且在速度-质量权衡上优于先前的GS方法。
原文摘要 · Abstract (English)
Arbitrary-Scale Super-Resolution (ASR) reconstructs images at continuous magnification factors. Recent methods accelerate inference by replacing computationally heavy implicit neural decoders with explicit 2D Gaussian Splatting (GS). However, since standard Gaussians are smooth low-pass primitives, modeling edges and fine textures requires multiple overlapping, well-aligned splats, which creates severe bottlenecks during rasterization. To address this, we introduce Resonant Brane Splatting (RBS), a feed-forward ASR framework. RBS replaces flat Gaussians with Branes: expressive primitives that emit spatially varying colors to natively model local contrast and complex textures within a single footprint. We achieve this by augmenting the standard Gaussian envelope with internal Gaussian-Hermite modes, assigning a distinct color coefficient to each. The zero-order mode recovers standard GS, while higher-order modes capture high frequencies. We predict Brane parameters directly from low-resolution features. Because Branes provide a mathematically richer formulation than simple Gaussians, far fewer primitives need to overlap to reconstruct a given target pixel. To exploit this, we introduce an efficient fully differentiable rasterizer with a precise culling strategy based on the classical quantum turning point. This allows us to safely skip negligible regions, drastically reducing the rendering overhead. Experiments on standard ASR benchmarks show that RBS improves reconstruction quality over implicit and GS baselines, while achieving superior speed-quality trade-off than prior GS methods.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。