This video was recorded at Code BEAM Europe 2022 - https://codesync.global/conferences/code-beam-sto-2022/ Smashing the Data Bottleneck with Federated Machine Learning on the BEAM | Vijay Chakilam - Head of Machine Learning at Partsimony ABSTRACT We know Erlang is all about fault tolerance. A well-engineered Erlang system – such as Kred, in the heart of Klarna’s business – will never stop, no matter what. Yet, about a year ago a short Kafka outage shook our mighty Kred so bad it knocked out all but one node. A few days later a second outage took down the entire cluster. How could this happen? This is the story of our hunt for the cluster-killer bug before it could strike again. It is a story of unexpected twists and descending to the deepest depths of the technology stack powering an Erlang application. OBJECTIVES Give some new tools for debugging low-level issues in an Erlang stack. Teach about Erlang’s memory model. AUDIENCE Developers who would like to add some new tricks to their debugging toolbox. • Timecodes 00:00 - 01:47 - Agenda 01:48 - 04:13 - Machine Learning 04:14 - 07:09 - Data Bottleneck 07:10 - 09:56 - Federated Machine Learning 09:57 - 11:58 - Motivation 11:59 - 13:14 - Challenges 13:15 - 21:37 - Federated Machine Learning on the BEAM 21:38 - 26:48 - Algorithms 26:49 - 30:31 - Future Work 30:32 - 36:55 - QnA • Follow us on social: Twitter: https://twitter.com/CodeBEAMio LinkedIn: https://www.linkedin.com/company/27159258 • Looking for a unique learning experience? Attend the next Code Sync conference near you! See what's coming up at: https://codesync.global • SUBSCRIBE TO OUR CHANNEL https://www.youtube.com/channel/UC47eUBNO8KBH_V8AfowOWOw See what's coming up at: https://codesync.global