用边缘计算保护隐私,让多用户虚拟协作更安全高效
PRISM-XR: Empowering Privacy-Aware XR Collaboration with Multimodal Large Language Models
- 在本地边缘端过滤敏感视觉数据,避免上传隐私信息
- 实现90%以上请求准确率,注册时间低于0.27秒
- 适合注重隐私的远程协作、教育或医疗类XR应用
多模态大语言模型(MLLM)通过结合自然语言与视觉输入,提升了扩展现实(XR)环境中的协作能力。然而,XR头显采集的视觉数据常包含无关或敏感信息,如桌上的信用卡、他人面部等,上传至云端模型处理存在严重隐私风险。现有商业XR API的共置与同步机制依赖耗时且侵入式的环境扫描,难以适应动态的MLLM集成环境。本文提出PRISM-XR框架,通过边缘服务器智能预处理帧数据,在传输前移除敏感内容和无关背景,实现隐私保护的多用户协作。同时引入轻量级注册流程与可定制的内容共享机制,确保高效、精准、隐私友好的内容同步。数值评估显示,系统请求满足率达近90%,注册时间低于0.27秒,空间一致性误差小于3.5厘米。经28名参与者的人体实验(已获伦理批准),系统在超90%场景中自动识别并过滤高敏感物体,整体可用性良好。
原文摘要 · Abstract (English)
Multimodal Large Language Models (MLLMs) enhance collaboration in Extended Reality (XR) environments by enabling flexible object and animation creation through the combination of natural language and visual inputs. However, visual data captured by XR headsets includes real-world backgrounds that may contain irrelevant or sensitive user information, such as credit cards left on the table or facial identities of other users. Uploading those frames to cloud-based MLLMs poses serious privacy risks, particularly when such data is processed without explicit user consent. Additionally, existing colocation and synchronization mechanisms in commercial XR APIs rely on time-consuming, privacy-invasive environment scanning and struggle to adapt to the highly dynamic nature of MLLM-integrated XR environments. In this paper, we propose PRISM-XR, a novel framework that facilitates multi-user collaboration in XR by providing privacy-aware MLLM integration. PRISM-XR employs intelligent frame preprocessing on the edge server to filter sensitive data and remove irrelevant context before communicating with cloud generative AI models. Additionally, we introduce a lightweight registration process and a fully customizable content-sharing mechanism to enable efficient, accurate, and privacy-preserving content synchronization among users. Our numerical evaluation results indicate that the proposed platform achieves nearly 90% accuracy in fulfilling user requests and less than 0.27 seconds registration time while maintaining spatial inconsistencies of less than 3.5 cm. Furthermore, we conducted an IRB-approved user study with 28 participants, demonstrating that our system could automatically filter highly sensitive objects in over 90% of scenarios while maintaining strong overall usability.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。