INFRA Signal 514
Virtio-nvgpu achieves near-native Nvidia GPU access in KVM guests
Comments
This development allows virtual machines to utilize Nvidia GPUs with minimal performance overhead, making it beneficial for applications like gaming or video encoding. By enabling multiple guests to share a single GPU without significant degradation in performance, it enhances resource efficiency in virtualized environments.
Written by elseif from the cluster below · every claim links back to a sourceThe three things worth knowing
Virtio-nvgpu forwards NVIDIA kernel driver ioctls directly, avoiding API-level translation.
Four guests can share a single RTX 3060 GPU without performance loss, maintaining frame rates and CPU usage.
Supported features include Vulkan rendering and NVENC encoding, though limitations exist on guest numbers and workloads.
THE READ
What the cluster adds up to.
The introduction of virtio-nvgpu allows for near-native performance of Nvidia GPUs within KVM guests, showcasing a remarkable capability for virtualization. With performance metrics indicating that guest frame rendering is within 2% of bare metal, this solution can effectively support high-demand applications, such as gaming and video processing, in virtualized setups.
Implementing virtio-nvgpu requires the appropriate Nvidia drivers and a compatible RTX GPU, such as the RTX 3060. The framework has been tested successfully with multiple guests rendering simultaneously, demonstrating its efficiency. However, it is essential to note that while it shows great promise, it currently does not support more than four guests or heavy workloads beyond basic rendering tasks.
The architecture of virtio-nvgpu is designed for flexibility, with separate licensing for the guest and host components. This separation facilitates contributions from different developers and allows for broader adoption. However, potential users need to be aware of the current limits regarding guest operations and the untested aspects of CUDA forwarding, which may affect certain applications.
Written by elseif from the cluster below · checked for specifics the sources never containedTHE CLUSTER