Loading…
In-person
1-4 April 2025
Learn More and Register to Attend

The Sched app allows you to build your schedule but is not a substitute for your event registration. You must be registered for KubeCon + CloudNativeCon Europe 2025 to participate in the sessions. If you have not registered but would like to join us, please go to the event registration page to purchase a registration.

Please note: This schedule is automatically displayed in British Summer Time (BST) (UTC +1). To see the schedule in your preferred timezone, please select from the drop-down menu to the right, above "Filter by Date." The schedule is subject to change and session seating is available on a first-come, first-served basis. 
← Back to schedule
Data Processing Efficiency: Optimizing Batch Workloads on Kubernetes With Custom Schedulers - Hichem Kenniche, Independent
Friday April 4, 2025 14:30 - 15:00 BST
Level 1 | Hall Entrance S10 | Room C
Kubernetes is the leading platform for deploying major data processing frameworks like Apache Spark. However, its default scheduler falls short in meeting some of the advanced and specific requirements of batch workloads.

This presentation explores the necessity and benefits of custom schedulers, with a deep dive on the implementation of Volcano and Apache YuniKorn in multi-cloud Kubernetes environments running large and complex Apache Spark applications. Discover how these tools can optimize cluster management for batch and ML workloads.
Speakers
avatar for Hichem Kenniche

Hichem Kenniche

Principal Data Architect, Independent
Hichem is a passionate advocate and user for open-source technologies, including Kubernetes and its ecosystem, Apache Spark, Kafka, Airflow, and more. Hichem, with over a decade of experience in Data Analytics and AI/ML, effectively addresses complex Data Platform challenges as a... Read More →
Data Processing Efficiency Optimizing Batch Workloads on Kubernetes with Custom Schedulers Hichem Kenniche pdf
Friday April 4, 2025 14:30 - 15:00 BST
Level 1 | Hall Entrance S10 | Room C
  Data Processing + Storage
  • Content Experience Level Advanced
  • Presentation Slides Attached Yes

Sign up or log in to save this to your schedule, view media, leave feedback and see who's attending!

Tweet Share
Share Modal

Share this link via

Or copy link