开源联邦视觉定位系统,让多机构共建共享室内空间的AR定位服务。
OpenFLAME: Federated Visual Positioning System to Enable Large-Scale Augmented Reality Applications
- 采用联邦学习框架,各机构独立扫描维护私有室内3D地图。
- 支持跨空间定位一致性,解决多地图融合与质量控制难题。
- 适合需要隐私保护的商业/教育/医疗类大规模AR应用。
世界规模的增强现实(AR)应用需要一个无处不在的6自由度定位后端,以确保内容在不同设备间一致地锚定于真实世界。谷歌、Niantic等大型组织正在对户外公共空间进行3D扫描,构建各自的视觉定位系统(VPS)。然而,这些中心化VPS方案无法满足未来众多AR应用的需求——由于隐私顾虑、法规限制及人工更新维护的瓶颈,难以覆盖私人室内空间。本文提出OpenFLAME,一种联邦视觉定位系统后端,允许独立机构对其自有空间进行3D扫描并维护专属的VPS服务。该方案实现室内3D扫描的访问控制、分布式维护和更大范围覆盖。地图分片引入了若干独特挑战:跨空间定位结果的一致性、VPS服务质量控制、位置对应的最优VPS选择等。我们提出基于图像的联邦定位概念,并提供无需共享私有数据即可管理与合并多地图数据的参考解决方案。
原文摘要 · Abstract (English)
World-scale augmented reality (AR) applications need a ubiquitous 6DoF localization backend to anchor content to the real world consistently across devices. Large organizations such as Google and Niantic are 3D scanning outdoor public spaces in order to build their own Visual Positioning Systems (VPS). These centralized VPS solutions fail to meet the needs of many future AR applications -- they do not cover private indoor spaces because of privacy concerns, regulations, and the labor bottleneck of updating and maintaining 3D scans. In this paper, we present OpenFLAME, a federated VPS backend that allows independent organizations to 3D scan and maintain a separate VPS service for their own spaces. This enables access control of indoor 3D scans, distributed maintenance of the VPS backend, and encourages larger coverage. Sharding of VPS services introduces several unique challenges -- coherency of localization results across spaces, quality control of VPS services, selection of the right VPS service for a location, and many others. We introduce the concept of federated image-based localization and provide reference solutions for managing and merging data across maps without sharing private data.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。