Machine Learning Engineering Done Right | Joshua Arvin Lat | Conf42 Python 2021
Joshua Arvin Lat CTO @ Nuworks Interactive Labs It is not an easy task to design and build systems that involve Machine Learning and Data Science requirements. In addition to this, managing the complexity of intelligent systems requires careful planning and execution. In this talk, I will share the different strategies and solutions on how to design, build, deploy, and maintain complex intelligent systems and workflows. I will discuss how different concepts like Metaprogramming, Infrastructure as Code, Continuous Integration and Deployment, and Architecture Patterns work in the real world and how these concepts are used in a practical setting. We will talk about how to use Python with different tools and services to perform machine learning experiments ranging from fully abstracted to fully customized solutions. These include performing automated hyperparameter optimization and bias detection when dealing with intermediate requirements and objectives. We will also show how these are done with different ML libraries and frameworks such as Scikit-learn, PyTorch, TensorfFlow, Keras, MXNet, and more. In addition to these, I will also share some of the risks and common mistakes Machine Learning Engineers must avoid to help bridge the gap between reality and expectations. While discussing these topics, we will show how containerization and serverless engineering helps solve our technical requirements. While discussing these concepts, tools, frameworks, and techniques, we will provide several examples and recipes on how these ML workflows and systems solve different business requirements (e.g., finance, digital transformation, automation, sales). β 0:00 Intro 0:25 Talk More Timestamps to come β π₯ Gold Sponsors: Behalf TerminusDB π₯ Silver Sponsors 20tab Aiven.io Double Data Confirm MetaSnake Microapis.io MousePaw Media Nuworks Interactive Labs Teamland Think Evolve Consulting π€ Media Partners AWS Inside Dev Manning Packt β Website ππͺ https://www.conf42.comβ Reach Out π§π mark@conf42.com Discord Server π§βπ€βπ§π¬ https://discord.gg/DnyHgrC7jC LinkedIn π¨βπΌπΌ https://www.linkedin.com/company/4911...β Twitter π΅π¦https://twitter.com/conf42comβ Conf42Cast π§ http://www.conf42.com/podcast