Read the abstract ➤ https://www.conf42.com/DevSecOps_2023_Robert_Hodges_monitoring_open_source_analytics_visualization Other sessions at this event ➤ https://www.conf42.com/devsecops2023 Join Discord ➤ https://discord.gg/DnyHgrC7jC Chapters 0:00 intro 1:43 preamble 2:07 about robert 3:21 monitoring is for answering questions 3:55 what's the best way to answer these questions? 4:36 off-the-shelf solutions? perhaps not for you... 5:23 let's build a monitoring system with open source 6:06 pick an opne source analytic database 7:22 a short list of reasons why clickhouse is popular 8:50 clickhouse optimizes for fast response on large datasets 10:35 ...and supports [many] dozens of input formats 11:16 it also has great support for time-ordered data 12:30 grafana pairs well with clickhouse for observability apps 14:00 sooo... how do we ingest vmstat data and display it? 14:23 step 1: generate vmstat data 15:12 here's the output 15:38 step 2: design a clickhouse table to hold data 17:28 step 3: load data into clickhouse 18:23 step 4: build a grafana dashboard to show results 19:26 step 5: go crazy! 20:12 demo 26:38 more software to build monitoring on clickhouse 27:51 where can i find out more? 28:54 thank you and have fun!