This video was recorded at Code BEAM America 2021 - https://codesync.global/conferences/code-beam-sf-2021/ When you have to make it faster | Marc Sugiyama & Niko Tsikoudis - Experienced Erlang engineer & Software Engineer at Datometry ABSTRACT Our product, Hyper-Q, enables modern cloud data warehouses to emulate Teradata, aiding with the migration of on-premises solutions to the cloud. Hyper-Q translates existing applications' queries in real-time to run natively in the cloud and converts data received from the cloud into the format needed by the application. We recently missed service level agreements with a customer because our product, Hyper-Q, added significant overhead to a data warehouse application. Through careful investigation, using profilers, continuous improvement, and focused engineering considering Erlang characteristics, we doubled our performance and improved system scalability. This talk describes the steps and techniques we used to understand where to focus our engineering efforts and beat our service level agreements. • Timecodes 00:00 - 04:44 - Introduction to Datometry/ Hyper Q 04:45 - 06:05 - Customer Incident 06:06 - 08:25 - In House Reproduction 08:26 - 09:55 - Identifying Dominant Cost 09:56 - 15:22 - How do we make Data Conversion Faster? 15:23 - 17:21 - Optimization Example 17:22 - 17:52 - Result 17:53 - 19:30 - Profiling Takeaways 19:31 - 23:50 - Binary Optimizations 23:51 - 26:22 - Improvements 26:23 - 27:16 - Optimizations 27:17 - 28:06 - Next Steps 28:07 - 35:14 - QnA • Follow us on social: Twitter: https://twitter.com/CodeBEAMio LinkedIn: https://www.linkedin.com/company/27159258 • Looking for a unique learning experience? Attend the next Code Sync conference near you! See what's coming up at: https://codesync.global • SUBSCRIBE TO OUR CHANNEL https://www.youtube.com/channel/UC47eUBNO8KBH_V8AfowOWOw See what's coming up at: https://codesync.global