Profile, Optimize, Repeat: One Core Is All You Need™ — Valentin Nieper, Jonathan Striebel
[EuroPython 2024 — Terrace 2A on 2024-07-11] Profile, Optimize, Repeat: One Core Is All You Need™ by Valentin Nieper, Jonathan Striebel https://ep2024.europython.eu/session/profile-optimize-repeat-one-core-is-all-you-needtm Your data analysis pipeline works. Nice! Could it be faster? Probably. Do you need to parallelize? Not yet. Discover optimization steps that boost the performance of your data analysis pipeline on a single core, reducing time & costs. This walkthrough shows tools to identify bottlenecks via profiling, and strategies to mitigate those, demonstrating them in an example. To improve our memory and runtime performance we will use numpy, numba jit-ing and pybind11 extensions. --- This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License: https://creativecommons.org/licenses/by-nc-sa/4.0/