arXiv:2512.08478cs.CVcs.AI2025-12被引 2

基于WebGPU的轻量级3D高斯渲染平台,支持实时动态生成与交互。

Visionary: The World Model Carrier Built on WebGPU-Powered Gaussian Splatting Platform

  • 用WebGPU+ONNX实现在浏览器内帧级推理与渲染
  • 相比现有网页查看器效率更高,支持多种3DGS变体
  • 适合研究者快速部署、对比和展示神经渲染模型

神经渲染,尤其是3D高斯点阵(3DGS),已迅速发展并成为构建世界模型的关键组件。然而,现有查看器解决方案仍分散、臃肿或受限于旧有管线,导致部署门槛高,难以支持动态内容与生成模型。本文提出Visionary,一个开源、原生支持Web的实时3D高斯点阵与网格渲染平台。基于高效的WebGPU渲染器与帧级ONNX推理,Visionary在保持轻量化、一键运行的浏览器体验的同时,实现动态神经处理。其引入标准化的高斯生成器合约,不仅支持标准3DGS渲染,还可插件式接入每帧生成或更新高斯点的算法,并支持前馈式生成后处理。平台还提供集成三.js的插件库及简洁的TypeScript API,便于嵌入现有Web应用。实验表明,在相同3DGS资产下,由于基于GPU的图元排序,Visionary在渲染效率上优于当前主流Web查看器。现已支持多种变体,包括基于MLP的3DGS、4DGS、神经角色、风格转换与增强网络。通过在浏览器中统一推理与渲染,Visionary显著降低了3DGS类方法的复现、对比与部署门槛,成为重建与生成范式共存的世界模型载体。

原文摘要 · Abstract (English)

Neural rendering, particularly 3D Gaussian Splatting (3DGS), has evolved rapidly and become a key component for building world models. However, existing viewer solutions remain fragmented, heavy, or constrained by legacy pipelines, resulting in high deployment friction and limited support for dynamic content and generative models. In this work, we present Visionary, an open, web-native platform for real-time various Gaussian Splatting and meshes rendering. Built on an efficient WebGPU renderer with per-frame ONNX inference, Visionary enables dynamic neural processing while maintaining a lightweight, "click-to-run" browser experience. It introduces a standardized Gaussian Generator contract, which not only supports standard 3DGS rendering but also allows plug-and-play algorithms to generate or update Gaussians each frame. Such inference also enables us to apply feedforward generative post-processing. The platform further offers a plug in three.js library with a concise TypeScript API for seamless integration into existing web applications. Experiments show that, under identical 3DGS assets, Visionary achieves superior rendering efficiency compared to current Web viewers due to GPU-based primitive sorting. It already supports multiple variants, including MLP-based 3DGS, 4DGS, neural avatars, and style transformation or enhancement networks. By unifying inference and rendering directly in the browser, Visionary significantly lowers the barrier to reproduction, comparison, and deployment of 3DGS-family methods, serving as a unified World Model Carrier for both reconstructive and generative paradigms.

3D高斯WebGPU神经渲染浏览器部署

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。