The Streaming Plane | Hubert Dulay | Conf42 Platform Engineering 2024

Conference: Conf42 Platform Engineering 2024

Year: 2024

Read the abstract ➤ https://www.conf42.com/Platform_Engineering_2024_Hubert_Dulay_streaming_plane Other sessions at this event ➤ https://www.conf42.com/platform2024 Support our mission ➤ https://www.conf42.com/support Join Discord ➤ https://discord.gg/mvHyZzRGaQ Chapters 0:00 intro 0:14 overview of key concepts 1:24 understanding the data divide 2:52 operational vs analytical data planes 3:49 challenges in data movement 4:30 introduction to data gravity 5:22 the streaming plane explained 6:07 synchronous vs asynchronous data serving 7:44 data locality and replication 8:28 materialized views and query optimization 9:16 balancing push and pull queries 11:48 global replication and local consumption 12:45 streaming data catalog and governance 13:31 conclusion and summary