首个4D风格化评测基准,助力动态3D场景风格迁移研究
Style4D-Bench: A Benchmark Suite for 4D Stylization
- 基于4D高斯点云构建风格化框架,实现时空一致的外观控制
- 在多个动态场景上达到当前最佳效果,保持时序稳定与多视角一致
- 适合关注动态3D渲染、风格迁移的研究者和开发者
我们提出首个专为4D风格化设计的评测基准Style4D-Bench,旨在统一评估标准并推动该新兴领域发展。该基准包含:1)涵盖空间保真度、时间连贯性与多视角一致性的综合评估协议,结合感知与量化指标;2)一个强基线模型,首次尝试4D风格化任务;3)一组高分辨率动态4D场景数据集,覆盖多样运动与复杂背景。为建立基线,我们提出Style4D框架,基于4D高斯点云(4DGS),由三部分组成:基础4DGS场景表示以捕捉可靠几何结构,风格高斯表示通过轻量级每点MLP实现时空感知外观控制,以及整体几何保形风格迁移模块,通过对比一致性学习与结构内容保留增强时空一致性。在Style4D-Bench上的大量实验表明,Style4D在4D风格化中表现领先,生成精细风格细节的同时保持稳定时序动态与一致多视角渲染。我们期望Style4D-Bench成为动态3D场景风格化渲染研究的重要资源。
原文摘要 · Abstract (English)
We introduce Style4D-Bench, the first benchmark suite specifically designed for 4D stylization, with the goal of standardizing evaluation and facilitating progress in this emerging area. Style4D-Bench comprises: 1) a comprehensive evaluation protocol measuring spatial fidelity, temporal coherence, and multi-view consistency through both perceptual and quantitative metrics, 2) a strong baseline that make an initial attempt for 4D stylization, and 3) a curated collection of high-resolution dynamic 4D scenes with diverse motions and complex backgrounds. To establish a strong baseline, we present Style4D, a novel framework built upon 4D Gaussian Splatting. It consists of three key components: a basic 4DGS scene representation to capture reliable geometry, a Style Gaussian Representation that leverages lightweight per-Gaussian MLPs for temporally and spatially aware appearance control, and a Holistic Geometry-Preserved Style Transfer module designed to enhance spatio-temporal consistency via contrastive coherence learning and structural content preservation. Extensive experiments on Style4D-Bench demonstrate that Style4D achieves state-of-the-art performance in 4D stylization, producing fine-grained stylistic details with stable temporal dynamics and consistent multi-view rendering. We expect Style4D-Bench to become a valuable resource for benchmarking and advancing research in stylized rendering of dynamic 3D scenes. Project page: https://becky-catherine.github.io/Style4D . Code: https://github.com/Becky-catherine/Style4D-Bench .
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。