Architectural Best Practices for Large-Scale Data Systems | Santosh Nikhil Kumar | Conf42 CN 2024
Read the abstract ➤ https://www.conf42.com/Cloud_Native_2024_Santosh_Nikhil_Kumar_architectural_largescale_data Other sessions at this event ➤ https://www.conf42.com/cloud2024 Support our mission ➤ https://www.conf42.com/support Join Discord ➤ https://discord.gg/DnyHgrC7jC Chapters 0:00 intro 0:24 preamble 1:06 storage architecture & retrieval 3:38 b-trees vs quadtrees vs lsm trees vs r-trees vs inverted index 7:24 why b-trees in distributed email service 10:49 why quad-trees in proximity service 16:09 why lsm-trees in write-heavy system 20:06 why inverted indexx in search engines 22:42 partitioning database:- secondary indices 23:36 partitioning secondary index - local 27:32 partitioning secondary index - global 29:50 local vs global 32:22 conflict free replicated datatypes (crdts) 32:57 write conflict in multi-leader replication 38:54 solution: conflicat free replicated datatypes 40:47 inside-out vs outside-in architecture 45:48 inside out vs outside in