Read the abstract ➤ https://www.conf42.com/Cloud_Native_2024_Akshay_Jain_aws_streaming_pipeline Other sessions at this event ➤ https://www.conf42.com/cloud2024 Support our mission ➤ https://www.conf42.com/support Join Discord ➤ https://discord.gg/DnyHgrC7jC Chapters 0:00 intro 0:24 preamble 1:02 use case 3:23 requirements 4:43 shard data distribution 14:30 process large records 17:38 schema registry 19:49 validations 23:39 thank you!