将视觉模型分片部署,实现边缘端隐私保护的图像分割。
A Distributed Framework for Privacy-Enhanced Vision Transformers on the Edge
- 用边缘设备拆分图像并分发至多个云端服务器
- 单个服务器无法还原完整图像,保障数据不泄露
- 在保持接近基线性能前提下大幅提升隐私安全
当前视觉智能工具已广泛应用,但其高算力需求超出移动与可穿戴设备承载能力。传统云端计算虽能缓解算力压力,却带来传输与服务器端的隐私风险。为此,本文提出一种面向视觉变换器(ViTs)的分布式分层卸载框架,通过本地可信边缘设备(如手机或Nvidia Jetson)作为协调者,将用户视觉数据分块并分发至多个独立云端服务器。设计上确保任一外部服务器均无法获取完整图像,杜绝数据重建可能。最终的数据融合与聚合计算仅在用户可信边缘设备上完成。以Segment Anything Model(SAM)为案例,实验证明该方法在保持近似基线分割性能的同时,显著降低内容重构与用户数据暴露风险。本框架为边缘-云连续体中的视觉任务提供了可扩展、隐私友好的解决方案。
原文摘要 · Abstract (English)
Nowadays, visual intelligence tools have become ubiquitous, offering all kinds of convenience and possibilities. However, these tools have high computational requirements that exceed the capabilities of resource-constrained mobile and wearable devices. While offloading visual data to the cloud is a common solution, it introduces significant privacy vulnerabilities during transmission and server-side computation. To address this, we propose a novel distributed, hierarchical offloading framework for Vision Transformers (ViTs) that addresses these privacy challenges by design. Our approach uses a local trusted edge device, such as a mobile phone or an Nvidia Jetson, as the edge orchestrator. This orchestrator partitions the user's visual data into smaller portions and distributes them across multiple independent cloud servers. By design, no single external server possesses the complete image, preventing comprehensive data reconstruction. The final data merging and aggregation computation occurs exclusively on the user's trusted edge device. We apply our framework to the Segment Anything Model (SAM) as a practical case study, which demonstrates that our method substantially enhances content privacy over traditional cloud-based approaches. Evaluations show our framework maintains near-baseline segmentation performance while substantially reducing the risk of content reconstruction and user data exposure. Our framework provides a scalable, privacy-preserving solution for vision tasks in the edge-cloud continuum.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。