KubeCon + CloudNativeCon Europe 2025

Want to understand how Kubernetes handles GPUs? Join us for a beginner-friendly deep dive into GPU integration using a homelab setup with NVIDIA Jetson hardware. Rather than relying solely on operators, we'll break down the entire stack to reveal how Kubernetes orchestrates GPU workloads. This session walks through the complete journey of enabling GPU support in Kubernetes, from bare metal to running GPU-accelerated containers.

Using a practical homelab example with a Jetson NUC, we'll explore how Kubernetes detects and manages GPU hardware, the critical role of drivers and container toolkit, and how kubelet plugins enable GPU support. You'll understand the mechanics of node labeling, GPU resource allocation, and the process of requesting GPU resources in Pod specifications. We'll also demystify CUDA and its essential role in GPU computing. Whether you're new to GPU computing or looking to understand the internals beyond operator abstractions, this talk is for you.