arXiv:2605.01352cs.OScs.AI2026-05

让CUDA和Vulkan在同显卡上并行计算,提升仿真效率

VUDA: Breaking CUDA-Vulkan Isolation for Spatial Sharing of Compute and Graphics on the Same GPU

论文配图:VUDA: Breaking CUDA-Vulkan Isolation for Spatial Sharing of Compute and Graphics on the Same GPU
图 1 · 摘自论文原文
  • 通过通道重定向和页表嫁接,打破CUDA与Vulkan隔离
  • 实测吞吐量比传统方案高85%,延迟更低
  • 适合需要渲染与仿真并发的智能体仿真场景

面向具身AI的基于GPU的仿真环境需在单个设备上交替执行物理仿真(CUDA)与逼真渲染(Vulkan)。我们观察到,仿真数据生成与强化学习训练两类典型场景可自然地将仿真与渲染阶段并行执行,通过空间多路复用显著提升GPU利用率。然而,一种称为执行隔离的根本障碍阻碍了这一潜力:CUDA与Vulkan创建独立的GPU上下文,其通道分属不同调度组,导致计算与图形任务只能互斥运行。现有空间共享技术局限于CUDA生态,而时间共享方案资源利用不足。本文提出VUDA,一个打破执行隔离、实现CUDA计算与Vulkan图形工作负载空间并行的系统。VUDA基于两个关键发现:尽管CUDA与Vulkan抽象不同,其执行路径在驱动与硬件层汇聚于共同的通道原语;同时二者虚拟地址空间天然分离,使得安全的页表合并无需重映射。VUDA通过轻量API让开发者标注可协同调度的CUDA流,并通过通道重定向至Vulkan调度域、页表嫁接统一地址空间,彻底消除关键路径上的数据复制。在代表性具身AI工作负载上,实验显示VUDA相较时序共享基线最高提升85%吞吐量,同时提升GPU利用率并降低端到端延迟。

原文摘要 · Abstract (English)

GPU-based simulation environments for embodied AI interleave physics simulation (CUDA) and photorealistic rendering (Vulkan) on a single device. We observe that two foundational scenarios -- simulation data generation and RL training -- can be naturally adapted to execute their simulation and rendering phases concurrently, presenting a significant opportunity to improve GPU utilization through spatial multiplexing. However, a fundamental obstacle we term execution isolation prevents this: CUDA and Vulkan create separate GPU contexts whose channels are bound to different scheduling groups, confining compute and graphics to mutually exclusive time slices. Existing spatial-sharing techniques are limited to the CUDA ecosystem, while temporal-sharing approaches underutilize available resources. This paper presents VUDA, a system that breaks execution isolation to enable spatial parallelism between CUDA compute and Vulkan graphics workloads. VUDA is built on two key observations: although CUDA and Vulkan expose different programming abstractions, their execution paths converge to a common channel primitive at the driver and hardware level; meanwhile, their virtual-address spaces are inherently disjoint, making safe page-table merging feasible without remapping. VUDA exposes a thin API for developers to annotate co-schedulable CUDA streams, and realizes spatial sharing through channel redirection into Vulkan's scheduling domain and page-table grafting to unify address spaces, eliminating all data copying on the critical path. Experiments on representative embodied-AI workloads show that VUDA delivers up to 85% higher throughput than temporal-sharing baselines, while improving GPU utilization and reducing end-to-end latency.

GPU调度并行计算仿真系统

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。