Read the abstract ➤ https://www.conf42.com/Cloud_Native_2024_Ahmed_Gaber_Nadine_Khaled_chidori_ai_ml_cluster Other sessions at this event ➤ https://www.conf42.com/cloud2024 Support our mission ➤ https://www.conf42.com/support Join Discord ➤ https://discord.gg/DnyHgrC7jC Chapters 0:00 intro 0:24 preamble 0:48 agenda 1:04 spark on kubernetes 2:30 advantages 4:07 challenges 10:38 chidori 11:19 high level design 14:27 ai/ml cluster management 14:56 demo 19:06 thank you!