Name: Sponsored Demo: Beyond Basic Routing: Building an AI-Aware HAProxy Gateway for LLM Security - Jakub Suchy, HAProxy
Start: 2025-04-03T11:00:00+0100
End: 2025-04-03T11:20:00+0100

In-person
1-4 April 2025
Learn More and Register to Attend

The Sched app allows you to build your schedule but is not a substitute for your event registration. You must be registered for KubeCon + CloudNativeCon Europe 2025 to participate in the sessions. If you have not registered but would like to join us, please go to the event registration page to purchase a registration.

Please note: This schedule is automatically displayed in British Summer Time (BST) (UTC +1). To see the schedule in your preferred timezone, please select from the drop-down menu to the right, above "Filter by Date." The schedule is subject to change and session seating is available on a first-come, first-served basis.

MONDAY: Maintainer Summit Schedule (Pre-Registration Required)
TUESDAY: CNCF-Hosted Co-located Events Schedule (Pre-Registration Required)

Thursday April 3, 2025 11:00 - 11:20 BST

Level 1 | Solutions Showcase | Hall Entrances S8 - S9 | Demo Theater

How can you enhance your load balancer with AI?

As LLMs become ubiquitous, managing AI traffic requires innovative approaches. We'll show how to use HAProxy's Stream Processing Offload Engine (SPOE) to create an intelligent AI gateway.

This proof-of-concept demonstrates how to evaluate prompts in transit, adding functionality beyond basic routing. You'll learn to:
Calculate tokens in real time.
Detect PII before it reaches your LLMs.
Evaluate for potential threats or abuse.
Set up the whole system with real examples you can use.

This demo explores extending AI Gateway functionality beyond conventional implementations. By using AI to secure AI traffic, we address the new challenges organizations face when scaling LLM deployments.

Join us to see how a load balancer can be enhanced with AI capabilities for more intelligent, secure gateways.

Speakers

Jakub Suchy

Director of Solutions Engineering, HAProxy Technologies

Jakub Suchy is the Director of Solutions Engineering at HAProxy Technologies, where he designs and prototypes solutions for application delivery and load balancing infrastructure. With his background in Linux infrastructure and Open Source Applications, he specializes in developing... Read More →

Thursday April 3, 2025 11:00 - 11:20 BST
Level 1 | Solutions Showcase | Hall Entrances S8 - S9 | Demo Theater

Solutions Showcase, Demo Theater

KubeCon + CloudNativeCon Europe 2025

Jakub Suchy

Sign up or log in to save this to your schedule, view media, leave feedback and see who's attending!