Name: Keynote: An Optimized Linux Stack for GenAI Workloads - Michael Yuan, WasmEdge
Start: 2025-06-10T09:41:00+0800
End: 2025-06-10T09:51:00+0800

10-11 June
Learn More and Register to Attend

The Sched app allows you to build your schedule but is not a substitute for your event registration. You must be registered for KubeCon + CloudNativeCon China 2025 to participate in the sessions. If you have not registered but would like to join us, please go to the event registration page to purchase a registration.

Please note: This schedule is automatically displayed in Hong Kong Standard Time (UTC+8:00). To see the schedule in your preferred timezone, please select from the drop-down menu to the right, above "Filter by Date." The schedule is subject to change and session seating is available on a first-come, first-served basis.

Tuesday June 10, 2025 09:41 - 09:51 HKT

Level 19 | Crystal Court I+II

Running GenAI workloads on Linux is a challenge due to the complexity of AI runtime toolchains and dependencies of heterogeneous GPU devices. The problem is especially acute in containers where the host and guest OSes must have compatible versions of GPU drivers and application software stacks.

CNCF’s Flatcar Linux project aims to simplify containerized Linux deployment. It has an immutable system that can be optimized for both host and guest systems. Furthermore, it supports cross-platform and cross-GPU Wasm workloads. As Wasm runtimes such as WasmEdge and LlamaEdge support a wide range of AI models, Flatcar Linux has become a good candidate for running GenAI workloads in containers.

In this talk, we will cover the basics of Flatcar and its support for Wasm runtimes. We will also discuss WasmEdge’s support for portable AI models and inference applications. Finally, we will give a demo of a complete GenAI app running in Flatcar across GPUs and CPUs.

Speakers

Michael Yuan

Founder and Maintainer, WasmEdge

Dr. Michael Yuan is a maintainer of WasmEdge Runtime (a project under CNCF) and a co-founder of Second State. He is the author of 5 books on software engineering published by Addison-Wesley, Prentice-Hall, and O'Reilly. Michael is a long-time open-source developer and contributor... Read More →

Tuesday June 10, 2025 09:41 - 09:51 HKT
Level 19 | Crystal Court I+II

Keynote Sessions, Emerging + Advanced

Content Experience Level Any
Presentation Language English

KubeCon + CloudNativeCon China 2025

Michael Yuan

Sign up or log in to save this to your schedule, view media, leave feedback and see who's attending!