Name: Sponsored Demo: 65,000 Node Clusters for Massive AIML Training and Inference Workload - Mofi Rahman, Google
Start: 2025-04-02T13:00:00+0100
End: 2025-04-02T13:20:00+0100

In-person
1-4 April 2025
Learn More and Register to Attend

The Sched app allows you to build your schedule but is not a substitute for your event registration. You must be registered for KubeCon + CloudNativeCon Europe 2025 to participate in the sessions. If you have not registered but would like to join us, please go to the event registration page to purchase a registration.

Please note: This schedule is automatically displayed in British Summer Time (BST) (UTC +1). To see the schedule in your preferred timezone, please select from the drop-down menu to the right, above "Filter by Date." The schedule is subject to change and session seating is available on a first-come, first-served basis.

MONDAY: Maintainer Summit Schedule (Pre-Registration Required)
TUESDAY: CNCF-Hosted Co-located Events Schedule (Pre-Registration Required)

Wednesday April 2, 2025 13:00 - 13:20 BST

Level 1 | Solutions Showcase | Hall Entrances S8 - S9 | Demo Theater

AIML Workloads are getting bigger. For large scale training jobs we need Kubernetes clusters that can scale to sizes beyond what has been possible until now. In this demonstration we will showcase what it takes to scale Kubernetes to up to 65,000 nodes. We will also look at open source tools like Kueue and how Kueue efficiently manages a wide range of AI workload scenarios within a large, hypothetical AI company, running their AI workload on a 65,000-node Google Kubernetes Engine (GKE) cluster. We'll showcase Kueue's capabilities in handling train/inference fungibility, priority-based preemption, fair sharing, and topology-aware scheduling, providing insights into its effectiveness at this massive scale.

Speakers

Mofi Rahman

Developer Relations Engineer, Google Cloud

Mofi Rahman (@moficodes) is a Developer Advocate at Google. His favorite programming language these days is Go. He is a strong believer of the power of open source and importance of giving back to the community. He is a self proclaimed sticker collecting addict and has collected several... Read More →

Wednesday April 2, 2025 13:00 - 13:20 BST
Level 1 | Solutions Showcase | Hall Entrances S8 - S9 | Demo Theater

Solutions Showcase, Demo Theater

KubeCon + CloudNativeCon Europe 2025

Mofi Rahman

Sign up or log in to save this to your schedule, view media, leave feedback and see who's attending!