Read the abstract ➤ https://www.conf42.com/Cloud_Native_2024_Ankit_Virmani_streaming_data_pipelines Other sessions at this event ➤ https://www.conf42.com/cloud2024 Support our mission ➤ https://www.conf42.com/support Join Discord ➤ https://discord.gg/DnyHgrC7jC Chapters 0:00 intro 0:24 some terms used in streaming data 2:39 some interesting challenges in streaming 4:23 dilemma between correctness and completion 7:49 bringing all the concepts together 9:47 streaming at scale: infrastructure and code considerations