用场景流形建模代替图像对比,提升辐射场渲染质量评估的准确性。
From Explicit References to Scene Manifolds: Distributional Fidelity and Realism for Radiance Field Quality Assessment

- 将场景视为特征空间中的高斯分布,通过偏离程度衡量语义保真度
- 在多个基准上与人类判断高度一致,对任意视角轨迹均表现稳定
- 适合评估3DGS和NeRF生成的视图,尤其适用于无对齐参考的场景
辐射场表示如3D高斯点云(3DGS)可实现高质量新视角合成,但可能因重建、渲染和压缩引入复杂且视角相关的伪影。可靠的感知质量评估(QA)对于评价渲染结果并指导感知保真场景表示的设计至关重要。现有全参考QA指标需对齐参考图像,而近期跨参考指标虽放宽此要求,但在宽基线辐射场设置下,选择可靠邻近参考仍具挑战,尤其在任意轨迹和姿态下评估时。我们提出SCODA,一种轻量级场景条件化的客观质量评估方法,将QA从显式图像比对转向场景流形建模。每个场景的高质量观测被表示为深度特征空间中的多元高斯分布,生成衡量偏离场景分布程度的语义保真度分数。一个弱监督的畸变感知块判别器提供互补的真实感信号,两者通过无监督有界融合策略结合。在多个基准上的实验表明,该方法与人类判断高度一致,并在3DGS与NeRF生成的视图及轨迹上具备强泛化能力。代码已公开于https://gitlab.com/saeedmp/scoda。
原文摘要 · Abstract (English)
Radiance field representations such as 3D Gaussian Splatting (3DGS) enable high-quality novel view synthesis but can introduce complex, view-dependent artifacts from reconstruction, rendering, and compression. Reliable perceptual quality assessment (QA) is thus essential for evaluating rendered views and guiding the design of perceptually faithful scene representations. Existing full-reference QA metrics require an aligned reference image, while recent cross-reference metrics relax this requirement by comparing a test view with non-aligned references. However, under wide-baseline radiance field settings, selecting a reliable nearby reference can be difficult, particularly when evaluating views along arbitrary trajectories and poses. We propose SCODA, a lightweight scene-conditioned objective QA method that shifts QA from explicit image-to-image comparison to scene-manifold modeling. High-quality observations of each scene are represented as a multivariate Gaussian distribution in deep feature space, producing a semantic fidelity score that measures deviation from the scene distribution. A weakly-supervised distortion-aware patch discriminator provides a complementary realism signal, and both cues are combined through an unsupervised bounded fusion strategy. Experiments on multiple benchmarks show strong agreement with human judgments and robust generalization across GS- and NeRF-generated views and trajectories. Code is publicly available at https://gitlab.com/saeedmp/scoda.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。