针对3D高斯点云图像质量评估,提出新数据集与多维度评估方法。
3DGSI-Assessor: A Large-Scale Dataset and An LMM-based Method for 3D Gaussian Splatting Image Quality Assessment

- 基于大模型构建端到端的多维度质量评估框架。
- 在1.5万张图像上实现几何与颜色质量的精准预测。
- 适合需要精细化压缩优化的3D内容开发者使用。
3D高斯点云(3DGS)已成为实时新视角合成(NVS)的主流表示方式,但其存储开销使得压缩对实际部署至关重要。3DGS训练与压缩会引入浮点伪影和表面散射等特定失真,传统图像质量评估(IQA)指标无法捕捉。此外,几何与颜色属性的独立压缩可能导致解耦的维度特异性失真,需分别诊断,但现有指标仅输出单一总分。为此,我们构建了3DGS-IEval-15K+,一个大规模、多维度的3DGS压缩图像质量评估数据集,包含来自10个不同场景的15,200张图像,由6种代表性3DGS算法在系统设计的压缩级别下生成,并从20个战略选定点渲染,涵盖训练视图与挑战性新视图,标注了45,600个平均意见得分(MOS),覆盖整体、几何与颜色质量。基于该数据集,我们提出3DGSI-Assessor,一种集成全局语义与维度特异性局部特征的大规模多模态模型(LMM)框架,可在一次前向传播中预测三个维度质量。3DGSI-Assessor在3DGS-IEval-15K+上达到最先进性能,并在其他NVS基准上展现出良好泛化能力。数据集与代码将开源于https://github.com/YukeXing/3DGSI-Assessor。
原文摘要 · Abstract (English)
3D Gaussian Splatting (3DGS) has become a dominant representation for real-time novel view synthesis (NVS), yet its storage footprint makes compression indispensable for practical deployment. 3DGS training and compression introduce representation-specific distortions such as floating artifacts and surface scattering, which conventional image quality assessment (IQA) metrics fail to capture. Moreover, the independent compression of geometric and color attributes may lead to decoupled dimension-specific distortions that must be diagnosed separately, yet existing metrics report only a single overall score. To address these gaps, we present 3DGS-IEval-15K+, a large-scale, multi-dimensional IQA dataset for compressed 3DGS, comprising 15,200 images from 10 diverse scenes, produced by 6 representative 3DGS algorithms at systematically designed compression levels and rendered from 20 strategically selected viewpoints spanning both training views and challenging novel views, annotated with 45,600 mean opinion scores (MOSs) across overall, geometry, and color quality. Based on 3DGS-IEval-15K+, we propose 3DGSI-Assessor, an all-in-one 3DGS IQA framework that integrates global semantic and dimension-specific local features within a large multimodal model (LMM), predicting all three dimensions in a single forward pass. 3DGSI-Assessor achieves state-of-the-art performance on 3DGS-IEval-15K+, and exhibits competitive generalization on other NVS benchmarks. Dataset and code will be released at https://github.com/YukeXing/3DGSI-Assessor.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。