arXiv:2506.02380cs.MMcs.CV2025-06被引 5

首个真实世界3DGS场景的6自由度导航数据集,支持眼动与头部追踪。

EyeNavGS: A 6-DoF Navigation Dataset and Record-n-Replay Software for Real-World 3DGS Scenes in VR

  • 采集46人探索12个真实场景的头位与眼动数据,支持自由行走6-DoF导航
  • 在两个地点使用Meta Quest Pro设备录制,每帧同步记录头姿与注视点
  • 开源可回放的SIBR视图工具,适合研究视觉注意力与自适应渲染

3D高斯溅射(3DGS)是一种新兴的媒体表示方法,能以高保真度重建真实世界的三维场景,支持虚拟现实(VR)中的六自由度(6-DoF)导航。然而,开发和评估基于3DGS的应用程序并优化其渲染性能,需要真实的用户导航数据。目前,针对真实世界场景的高质量3DGS重建,尚缺乏可用的用户导航数据。本文提出首个公开可用的6-DoF导航数据集EyeNavGS,包含46名参与者在12个多样化真实场景中进行自由站立6-DoF导航的轨迹数据。数据在两个站点使用Meta Quest Pro头显采集,每帧同步记录头部姿态和眼动信息。针对每个场景,我们进行了细致的场景初始化,校正了场景倾斜与尺度,确保沉浸式体验的舒适性。同时,我们开源了带有录制与回放功能的SIBR视图器分支及一系列数据处理、转换与可视化工具。EyeNavGS数据集及其配套工具为6-DoF视口预测、自适应流传输、3D显著性分析和基于视点的渲染研究提供了重要资源。数据集地址:https://symmru.github.io/EyeNavGS/

原文摘要 · Abstract (English)

3D Gaussian Splatting (3DGS) is an emerging media representation that reconstructs real-world 3D scenes in high fidelity, enabling 6-degrees-of-freedom (6-DoF) navigation in virtual reality (VR). However, developing and evaluating 3DGS-enabled applications and optimizing their rendering performance, require realistic user navigation data. Such data is currently unavailable for photorealistic 3DGS reconstructions of real-world scenes. This paper introduces EyeNavGS (EyeNavGS), the first publicly available 6-DoF navigation dataset featuring traces from 46 participants exploring twelve diverse, real-world 3DGS scenes. The dataset was collected at two sites, using the Meta Quest Pro headsets, recording the head pose and eye gaze data for each rendered frame during free world standing 6-DoF navigation. For each of the twelve scenes, we performed careful scene initialization to correct for scene tilt and scale, ensuring a perceptually-comfortable VR experience. We also release our open-source SIBR viewer software fork with record-and-replay functionalities and a suite of utility tools for data processing, conversion, and visualization. The EyeNavGS dataset and its accompanying software tools provide valuable resources for advancing research in 6-DoF viewport prediction, adaptive streaming, 3D saliency, and foveated rendering for 3DGS scenes. The EyeNavGS dataset is available at: https://symmru.github.io/EyeNavGS/.

3DGSVR导航眼动追踪数据集

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。