arXiv:2409.04018cs.CV2024-09被引 5

破解XR设备能效、延迟与精度三难困境,实现60倍节能

Towards Energy-Efficiency by Navigating the Trilemma of Energy, Latency, and Accuracy

  • 通过算法、执行和数据三类优化协同设计,探索能效空间
  • 最高达60倍节能,延迟可快2倍或慢4倍,精度损失极小
  • 适合追求极致能效的沉浸式XR系统开发者参考

扩展现实(XR)通过无绳头戴设备提供沉浸式体验,但受限于电池与资源约束。能效设计对保障设备续航与高性能至关重要。然而,延迟与精度常被优先考虑,导致能效不足。本文以场景重建这一关键组件为研究对象,展示如何通过权衡能效、延迟与精度三者关系实现能效突破。我们探索了算法、执行和数据三类面向能耗的优化,通过可配置参数揭示广泛的设计空间,共生成72种设计方案,展现出较大的延迟与能耗权衡范围,而精度损失较小。我们识别出帕累托最优曲线,并表明只有通过三类优化的协同共优化,结合下游场景重建需求的延迟与精度要求,才能达到最优设计。在嵌入式系统上的多场景测试显示,相较基线,我们的方案最高实现60倍能耗降低,延迟范围为4倍延迟至2倍加速;在ScanNet数据集的典型用例中,实现约25倍能耗节省,延迟减少1.5倍,重建质量几乎无损。

原文摘要 · Abstract (English)

Extended Reality (XR) enables immersive experiences through untethered headsets but suffers from stringent battery and resource constraints. Energy-efficient design is crucial to ensure both longevity and high performance in XR devices. However, latency and accuracy are often prioritized over energy, leading to a gap in achieving energy efficiency. This paper examines scene reconstruction, a key building block for immersive XR experiences, and demonstrates how energy efficiency can be achieved by navigating the trilemma of energy, latency, and accuracy. We explore three classes of energy-oriented optimizations, covering the algorithm, execution, and data, that reveal a broad design space through configurable parameters. Our resulting 72 designs expose a wide range of latency and energy trade-offs, with a smaller range of accuracy loss. We identify a Pareto-optimal curve and show that the designs on the curve are achievable only through synergistic co-optimization of all three optimization classes and by considering the latency and accuracy needs of downstream scene reconstruction consumers. Our analysis covering various use cases and measurements on an embedded class system shows that, relative to the baseline, our designs offer energy benefits of up to 60X with potential latency range of 4X slowdown to 2X speedup. Detailed exploration of a use case across representative data sequences from ScanNet showed about 25X energy savings with 1.5X latency reduction and negligible reconstruction quality loss.

能效优化扩展现实三难困境场景重建

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。