arXiv:2604.13416cs.CVcs.AI2026-04中稿 · ed

构建1048场景的去干扰新视角合成数据集,推动真实世界泛化能力研究

DF3DV-1K: A Large-Scale Dataset and Benchmark for Distractor-Free Novel View Synthesis

论文配图:DF3DV-1K: A Large-Scale Dataset and Benchmark for Distractor-Free Novel View Synthesis
图 1 · 摘自论文原文
  • 构建包含1048个场景、89,924张图像的大规模真实世界数据集
  • 首次系统评估9种去干扰辐射场方法在128类干扰物下的鲁棒性表现
  • 提供可微调的扩散增强框架,提升重建质量平均0.96 dB PSNR

辐射场技术推动了逼真新视角合成的发展。尽管多个领域已建立大规模真实世界数据集以支持全面基准测试,但针对无干扰辐射场的大型数据集仍缺乏,尤其缺少每场景同时包含干净与杂乱图像的数据。为此,我们提出DF3DV-1K,一个包含1,048个场景的真实世界数据集,每个场景提供干净与杂乱图像用于基准测试。总计89,924张图像由消费级相机拍摄,模拟日常采集,覆盖128类干扰物和161种场景主题,涵盖室内外环境。其中41个精选场景构成子集DF3DV-41,专门用于评估去干扰辐射场方法在挑战性场景下的鲁棒性。基于该数据集,我们对九种近期去干扰辐射场方法及3D高斯泼溅进行基准测试,识别出最鲁棒的方法与最具挑战性的场景。此外,我们展示应用潜力:通过微调基于扩散的2D增强器,使辐射场方法在保留集(如DF3DV-41)和On-the-go数据集上平均提升0.96 dB PSNR与0.057 LPIPS。我们希望该数据集能促进无干扰视觉发展,推动超越场景特定方法的研究。数据集与排行榜见https://johnnylu305.github.io/df3dv1k_web/

原文摘要 · Abstract (English)

Advances in radiance fields have enabled photorealistic novel view synthesis. In several domains, large-scale real-world datasets have been developed to support comprehensive benchmarking and to facilitate progress beyond scene-specific reconstruction. However, for distractor-free radiance fields, a large-scale dataset with clean and cluttered images per scene remains lacking, limiting the development. To address this gap, we introduce DF3DV-1K, a large-scale real-world dataset comprising 1,048 scenes, each providing clean and cluttered image sets for benchmarking. In total, the dataset contains 89,924 images captured using consumer cameras to mimic casual capture, spanning 128 distractor types and 161 scene themes across indoor and outdoor environments. A curated subset of 41 scenes, DF3DV-41, is systematically designed to evaluate the robustness of distractor-free radiance field methods under challenging scenarios. Using DF3DV-1K, we benchmark nine recent distractor-free radiance field methods and 3D Gaussian Splatting, identifying the most robust methods and the most challenging scenarios. Beyond benchmarking, we demonstrate an application of DF3DV-1K by fine-tuning a diffusion-based 2D enhancer to improve radiance field methods, achieving average improvements of 0.96 dB PSNR and 0.057 LPIPS on the held-out set (e.g., DF3DV-41) and the On-the-go dataset. We hope DF3DV-1K facilitates the development of distractor-free vision and promotes progress beyond scene-specific approaches. The dataset and leaderboard are available at https://johnnylu305.github.io/df3dv1k_web/.

新视角合成数据集辐射场去干扰

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。